-- Logs begin at Sun 2021-11-21 16:34:59 UTC, end at Sun 2021-11-21 18:03:40 UTC. -- Nov 21 17:05:32.522902 dv-cinder-818696-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 21 17:05:32.532610 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Nov 21 17:05:32 2021] *** Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: nodename: dv-cinder-818696-2-iscsi Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: machine: x86_64 Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: clock source: unix Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: pcre jit disabled Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: detected number of CPU cores: 4 Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: current working directory: / Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: detected binary path: /usr/bin/uwsgi-core Nov 21 17:05:32.534563 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: your processes number limit is 47680 Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: your memory page size is 4096 bytes Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: detected max file descriptor number: 2048 Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: lock engine: pthread robust mutexes Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: thunder lock: enabled Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 21 17:05:32.535345 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 21 17:05:32.579327 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: Python main interpreter initialized at 0x55e555c6f9c0 Nov 21 17:05:32.579327 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: python threads support enabled Nov 21 17:05:32.579327 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: your server socket listen backlog is limited to 100 connections Nov 21 17:05:32.579327 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: your mercy for graceful operations on workers is 90 seconds Nov 21 17:05:32.579741 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: mapped 403077 bytes (393 KB) for 2 cores Nov 21 17:05:32.579741 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: *** Operational MODE: preforking *** Nov 21 17:05:32.580014 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: *** uWSGI is running in multiple interpreter mode *** Nov 21 17:05:32.580014 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: spawned uWSGI master process (pid: 100862) Nov 21 17:05:32.580226 dv-cinder-818696-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 21 17:05:32.581323 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: spawned uWSGI worker 1 (pid: 100863, cores: 1) Nov 21 17:05:32.581323 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: spawned uWSGI worker 2 (pid: 100864, cores: 1) Nov 21 17:05:32.581323 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 21 17:05:34.231989 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:05:34.231989 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: from cryptography.utils import int_from_bytes Nov 21 17:05:34.232679 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:05:34.232679 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: from cryptography.utils import int_from_bytes Nov 21 17:05:34.233954 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:05:34.233954 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: from cryptography.utils import int_from_bytes Nov 21 17:05:34.234435 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:05:34.234435 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: from cryptography.utils import int_from_bytes Nov 21 17:05:36.941780 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 17:05:36.942354 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 17:05:36.942451 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 17:05:36.942850 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 17:05:36.942932 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 17:05:36.943006 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 17:05:36.943348 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 17:05:36.943425 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 17:05:36.943702 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.943806 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 17:05:36.943999 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 17:05:36.944091 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.944328 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.944415 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.944643 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.944738 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.944972 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945080 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945276 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945377 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945595 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945689 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.945914 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946005 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946215 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946315 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946467 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946566 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946808 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.946904 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.947759 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.947869 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818696-2-iscsi {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948108 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948233 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948420 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948517 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818696-2-iscsi {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948731 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.948823 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949049 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949146 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949357 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949460 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949680 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949776 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.949979 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.950082 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.950302 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.950474 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.950606 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.950935 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951136 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951270 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951443 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951571 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951745 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.951867 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952051 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952201 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952383 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952516 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952690 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952828 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.952992 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953125 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953303 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953441 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953607 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953745 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.953923 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954049 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818696-2-iscsi {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954227 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954360 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954648 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818696-2-iscsi {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954793 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.954951 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955090 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955257 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955391 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955566 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955698 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.955951 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956096 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956269 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956403 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956569 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956696 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.956884 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957009 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957198 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957325 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957533 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957668 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957792 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.957914 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958108 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958234 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958404 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958535 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958738 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.958875 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959035 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959159 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959340 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959557 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959685 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959814 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.959937 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960073 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960197 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960318 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960440 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960568 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960749 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.960886 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961165 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961296 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961427 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961621 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961753 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.961894 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962028 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962164 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962289 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962418 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962560 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962738 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.962942 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963110 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963237 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963369 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963520 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963681 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963807 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.963937 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964060 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964192 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964317 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964445 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964569 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964706 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964836 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.964971 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965094 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965207 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965400 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965533 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965725 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.965883 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966057 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966189 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966318 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966453 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966651 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966819 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.966954 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967125 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967263 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967396 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967570 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967703 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.967873 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968017 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968178 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968305 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968497 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968625 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968816 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.968945 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969122 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969249 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969426 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969569 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969763 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.969889 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970019 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970153 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970316 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970451 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970666 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970810 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.970977 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971197 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971397 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971530 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971653 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971896 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.971896 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972184 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972372 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972512 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972512 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972744 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.972893 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973089 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973228 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973352 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973475 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973611 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973739 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.973873 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974054 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974204 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974334 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974458 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974590 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974754 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.974888 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975031 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975186 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975365 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975510 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975635 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975763 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975887 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.975887 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976144 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976318 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976458 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976660 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976825 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.976987 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.977166 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.977329 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.977504 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.977667 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.977855 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978023 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978150 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978285 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978451 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978615 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978798 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.978936 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979059 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979202 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979327 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979474 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979602 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979725 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.979933 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980069 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980194 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980323 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980454 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980623 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980754 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.980886 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981016 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981139 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981269 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981434 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981641 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981796 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.981926 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982054 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982184 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982314 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982445 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982570 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982719 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982853 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.982977 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983107 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983314 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983440 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983563 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983684 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983814 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.983944 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984077 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984200 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984322 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984452 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984576 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984710 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984839 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.984962 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985133 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985272 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985403 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985525 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985642 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985765 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.985887 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.986010 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:05:36.986183 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.986320 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.986522 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.986681 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.986861 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987003 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987191 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987332 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987520 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987649 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987835 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.987973 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988159 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988288 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988440 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988567 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988762 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.988896 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989070 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989206 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989378 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989512 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989690 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.989856 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990099 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990232 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990361 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990490 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990613 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990819 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.990971 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991106 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991237 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991367 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991523 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991662 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.991865 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992000 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992132 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992256 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992419 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992544 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992737 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.992884 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993044 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993231 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993383 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993529 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993719 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.993853 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.994586 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.994743 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.994938 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.995255 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.995442 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.995589 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.995794 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.995927 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996111 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996303 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996434 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996556 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996722 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.996858 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997037 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997181 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997346 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997502 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997657 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997787 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.997988 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998166 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998284 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998405 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998602 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998798 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.998934 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999059 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999217 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999347 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999523 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999650 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999809 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:36.999946 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000111 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000312 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000440 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000562 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000748 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.000878 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001007 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001165 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001330 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001487 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001649 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001774 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.001983 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002109 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002232 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002364 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002497 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002643 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002822 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.002950 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003131 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003271 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003433 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003560 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003731 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.003858 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004046 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004180 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004350 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004479 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004654 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004785 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.004952 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005105 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005242 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005373 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005541 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005694 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.005896 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006040 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006186 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006310 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006474 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006658 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006797 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.006932 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007063 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007187 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007353 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007490 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007685 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.007820 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008012 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008137 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008313 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008452 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008626 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008770 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.008973 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.009131 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.009286 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.009429 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.009570 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.010322 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.010527 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.010679 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.010807 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.010941 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011054 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011213 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011433 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011562 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011739 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.011877 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012104 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012241 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012372 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012497 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012628 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012759 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.012928 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013056 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013212 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013367 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013553 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013708 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.013861 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014000 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014167 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014304 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014463 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014591 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014790 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.014955 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015129 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015294 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015435 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015561 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015758 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.015915 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016089 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016229 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016409 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016564 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016727 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.016852 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017040 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017178 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017355 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017481 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017666 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017792 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.017974 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018146 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018280 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018402 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018572 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018718 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.018907 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019051 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019214 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019348 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019526 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019658 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019834 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.019960 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020142 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020269 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020450 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020668 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020808 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.020931 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021053 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021174 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021350 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021474 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021663 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021791 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.021999 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022147 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022340 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022465 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022600 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022782 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.022932 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023059 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023243 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023371 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023549 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023687 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023855 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.023981 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024160 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024293 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024462 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024588 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024765 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.024889 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.025071 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.025214 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.025908 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026033 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026217 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026349 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026530 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026691 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.026874 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027125 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027295 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027424 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027579 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027718 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.027718 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028027 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028222 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028363 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028500 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028702 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.028845 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029202 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029391 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029521 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029662 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029868 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.029992 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030114 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030236 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030358 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030496 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030770 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.030919 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031045 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031168 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031291 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031423 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031548 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031671 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031795 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.031917 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032049 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032212 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032351 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032557 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032686 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032807 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.032940 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033064 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033186 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033309 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033431 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033553 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033688 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033848 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.033977 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034099 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034256 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034382 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034518 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034722 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034855 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.034987 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035111 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035235 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035444 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035571 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035694 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035817 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.035988 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036126 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036296 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036424 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036599 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036725 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.036903 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037040 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037205 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037332 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037541 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037674 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037846 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.037980 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038144 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038269 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038453 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038579 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038791 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.038930 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039097 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039223 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039411 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039554 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039712 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039868 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.039997 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.040119 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.040317 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.040444 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.040623 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.040757 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.041623 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.041790 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.041927 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042181 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042181 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042442 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042581 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042803 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.042932 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043055 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043190 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043352 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043484 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043607 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043756 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.043899 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044034 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044165 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044288 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044445 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044574 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044705 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044858 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.044994 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.045423 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.045561 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.045752 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.045890 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046068 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046202 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046376 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046498 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046716 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.046866 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047028 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047154 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047351 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047477 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047674 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047801 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.047980 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048112 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048279 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048403 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048578 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048707 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.048878 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049010 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049179 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049309 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049476 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049602 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049768 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.049896 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050069 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050256 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050394 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050519 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050701 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050833 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.050958 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051099 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051257 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051392 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051564 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051775 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.051902 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052040 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052182 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052315 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052453 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052586 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052742 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.052949 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053083 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053208 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053341 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053466 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053631 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053787 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.053920 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054053 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054213 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054504 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054504 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054805 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.054931 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055069 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055202 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055326 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055449 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055572 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055764 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.055901 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056098 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056226 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056425 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056555 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056804 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.056955 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057089 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057214 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057337 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057602 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057738 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.057891 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058021 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058191 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058320 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058498 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058654 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.058823 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059013 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059135 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059361 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059496 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059722 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.059851 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060028 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060158 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060326 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060462 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060632 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060813 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.060941 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061186 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061315 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061558 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061684 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061865 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.061990 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.062113 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.062237 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.062373 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.062531 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.062710 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063005 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063153 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063300 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063439 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063570 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063754 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.063906 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064117 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064265 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064410 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064621 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064748 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.064920 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065092 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065283 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065413 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065580 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065713 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.065899 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066049 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066195 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066395 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066524 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066726 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.066855 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067065 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067210 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067387 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067506 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067731 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.067908 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.068291 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.068447 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.068576 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.068826 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.068962 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069150 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069272 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069456 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069571 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069759 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.069879 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070059 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070182 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070365 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070478 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070683 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070836 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.070986 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071197 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071314 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071559 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071688 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071852 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.071978 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.072203 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.072405 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.072527 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.072759 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.072846 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073085 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073264 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073384 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073649 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073788 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.073985 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074127 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074349 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074476 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074674 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074876 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.074981 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.075252 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.075360 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.075584 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.075679 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.075904 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076042 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076251 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076338 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076485 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076622 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076798 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.076947 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.077105 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.077359 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.077515 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.077704 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.077871 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078013 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078139 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078307 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078435 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078635 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078766 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.078944 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.079143 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.079270 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.079563 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.079699 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.079882 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080018 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080183 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080311 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080490 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080624 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080794 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.080927 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081089 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081217 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081395 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081522 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081699 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.081826 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082006 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082132 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082316 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082442 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082674 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082806 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.082941 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083072 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083244 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083356 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083549 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083647 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083853 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.083958 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084161 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084267 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084462 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084557 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084783 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.084901 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085087 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085191 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085393 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085545 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085694 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085829 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.085990 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086131 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086296 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086424 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086598 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086746 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.086938 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.087081 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.087246 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.087375 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.087554 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088217 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088426 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088560 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088669 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088783 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.088987 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089138 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089271 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089396 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089598 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089725 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.089907 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090035 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090243 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090370 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090497 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090684 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090810 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.090934 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091112 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091241 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091418 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091561 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091819 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.091999 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.092421 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.092547 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.092723 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.092858 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093072 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093248 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093389 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093586 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093713 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093835 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.093966 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.094152 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.094283 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.094413 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.094545 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.094774 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095010 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095204 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095341 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095518 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095675 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.095831 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096103 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096244 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096417 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096545 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096724 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.096851 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097036 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097166 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097353 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097486 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097656 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097782 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.097960 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098089 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098258 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098418 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098565 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098736 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.098896 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099032 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099217 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099344 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099524 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099660 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099844 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.099972 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100148 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100269 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100469 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100631 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100792 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.100942 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101105 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101251 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101424 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101572 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101839 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.101960 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102161 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102275 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102471 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102612 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102808 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.102934 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.103116 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.103340 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104148 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104286 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104413 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104536 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104773 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.104907 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105215 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105341 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105431 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105614 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105714 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105797 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.105994 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106097 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106351 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106461 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106661 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106764 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.106977 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107078 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107273 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107378 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107552 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107649 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.107879 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108034 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108197 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108300 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108534 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108640 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108819 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.108931 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109149 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109255 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109439 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109597 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109740 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.109879 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110052 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110178 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110356 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110485 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110681 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110822 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.110987 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111115 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111290 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111415 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111592 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111738 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.111893 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112033 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112215 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112342 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112519 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112648 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112841 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.112968 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113147 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113272 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113465 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113603 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113784 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.113912 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114139 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114274 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114412 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114537 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114713 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.114839 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115015 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115142 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115387 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115515 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115643 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115788 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.115917 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116049 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116176 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116299 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116468 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116595 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116775 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.116951 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117110 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117304 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117431 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117574 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117700 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117838 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.117965 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118117 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118244 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118431 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118572 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118771 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.118921 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.119121 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.119255 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.119424 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.119683 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.119799 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120026 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120152 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120328 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120450 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120631 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120797 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.120930 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121056 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121227 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121363 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121526 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121687 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.121815 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122016 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122145 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122329 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122489 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122674 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122806 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.122992 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123121 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123308 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123437 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123607 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123734 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.123913 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124070 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124206 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124333 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124521 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124656 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124834 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.124963 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.125142 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.125272 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.125561 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.125849 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126043 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126217 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126403 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126499 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126499 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126743 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126836 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.126957 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127043 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127269 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127374 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127584 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127701 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.127899 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128104 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128194 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128284 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128526 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128628 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128812 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.128961 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129115 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129211 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129422 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129516 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129730 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.129827 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130048 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130153 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130367 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130664 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130757 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.130944 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131116 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131258 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131387 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131553 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131681 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.131862 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132024 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132193 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132330 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132494 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132622 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132750 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.132875 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133062 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133221 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133359 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133485 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133667 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133800 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.133994 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.134142 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.134312 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.134441 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.135169 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.135331 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.135508 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.135727 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.135863 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136068 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136332 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136490 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136627 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136762 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.136888 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137024 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137150 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137284 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137425 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137648 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137796 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.137915 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138038 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138225 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138353 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138533 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138700 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.138897 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139050 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139184 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139315 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139474 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139695 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.139823 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140015 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140178 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140350 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140476 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140673 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140808 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.140978 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141119 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141298 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141458 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141608 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141733 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.141928 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142064 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142239 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142370 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142541 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142747 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.142874 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143002 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143173 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143453 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143596 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143741 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.143888 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144063 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144193 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144367 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144493 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144686 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144816 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.144995 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.145124 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.145306 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.145524 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.145665 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.145872 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146000 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146187 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146326 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146485 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146670 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146845 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.146973 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147148 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147282 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147456 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147597 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147808 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.147941 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148056 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148180 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148356 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148484 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148663 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148790 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.148967 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149201 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149361 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149560 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149693 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149871 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.149998 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.150841 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151081 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151303 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151437 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151588 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151827 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.151971 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152082 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152189 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152294 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152400 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152523 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152656 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152781 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.152904 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153064 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153194 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153325 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153450 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153610 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153798 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.153938 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154101 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154227 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154362 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154488 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154612 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154756 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.154879 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155041 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155171 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155344 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155472 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155667 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.155794 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156044 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156183 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156308 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156446 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156573 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156697 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156829 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.156962 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157139 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157280 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157429 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157558 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157730 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.157956 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158083 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158218 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158365 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158499 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158667 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158793 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.158916 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159039 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159217 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159357 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159530 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159691 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.159873 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160181 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160315 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160521 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160647 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160830 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.160959 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161135 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161274 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161473 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161680 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161795 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.161924 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162078 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162214 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162384 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162563 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162717 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.162856 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163041 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163184 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163337 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163465 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163648 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163775 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.163964 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.164267 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.164397 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.164577 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.164716 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.164886 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.165017 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.165342 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.165472 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.165720 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.165882 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.166260 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.166457 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.166640 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.166794 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.166967 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167123 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167275 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167451 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167585 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167736 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167851 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.167970 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168085 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168260 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168389 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168513 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168768 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.168930 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.169101 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.169253 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.169425 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.169575 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.169858 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.170034 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.170322 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.170556 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.170699 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.170979 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171149 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171283 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171422 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171594 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171807 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.171978 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.172210 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.172350 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.172523 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.172664 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.172842 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173010 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173146 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173400 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173537 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173782 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.173910 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.174109 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.174244 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.174437 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.174575 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.174773 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175078 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175205 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175382 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175571 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175703 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.175965 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.176093 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.176309 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.176444 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.176621 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.176903 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177035 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177235 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177361 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177548 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177686 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.177864 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178146 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178284 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178466 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178604 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178801 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.178925 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.179126 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.179382 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.179535 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.179736 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.179870 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.180043 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.180353 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.180485 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.180666 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181023 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181145 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181251 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181365 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181799 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.181942 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.182201 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.182413 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.182586 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.182956 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183100 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183281 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183409 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183598 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183787 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.183944 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.184221 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.184358 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.184533 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.184662 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.184848 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185054 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185239 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185454 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185583 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185772 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.185924 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.186087 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.186386 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.186561 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.186760 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.186992 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.187129 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.187371 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.187509 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.187722 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.187850 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.188039 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.188230 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.188565 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.188720 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.188906 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.189071 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 17:05:37.189328 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.189787 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.190182 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.190597 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.191003 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.191366 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.191723 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.192078 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.192451 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.192819 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.193425 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.193831 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.194197 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.194559 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.194956 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.195309 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.195694 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.196147 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.196574 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.196930 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.198012 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.198402 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.198870 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.199371 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.199662 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.200093 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.200482 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.200920 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.201283 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.201703 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.202126 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:05:37.202361 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 17:05:37.212920 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_db.sqlalchemy.engines [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.226669 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_db.sqlalchemy.engines [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.388686 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.context [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),30be9fce-2665-48f2-b5e2-b49d52c4b8ef(cell1) {{(pid=100863) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 17:05:37.393048 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_concurrency.lockutils [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:05:37.394660 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_concurrency.lockutils [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:05:37.395426 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_concurrency.lockutils [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:05:37.397455 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_concurrency.lockutils [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:05:37.404720 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.context [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),30be9fce-2665-48f2-b5e2-b49d52c4b8ef(cell1) {{(pid=100864) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 17:05:37.407678 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_db.sqlalchemy.engines [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.409195 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:05:37.410853 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:05:37.411315 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_db.sqlalchemy.engines [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.411710 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:05:37.413711 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:05:37.427449 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_db.sqlalchemy.engines [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.429611 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_db.sqlalchemy.engines [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.672839 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG oslo_db.sqlalchemy.engines [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:37.696158 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_db.sqlalchemy.engines [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:05:38.030453 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: WARNING keystonemiddleware.auth_token [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:05:38.037048 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: WARNING keystonemiddleware.auth_token [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:05:38.090658 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: WARNING keystonemiddleware.auth_token [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:05:38.097326 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: WARNING keystonemiddleware.auth_token [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:05:38.390300 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: WARNING keystonemiddleware.auth_token [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:05:38.395561 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: WARNING keystonemiddleware.auth_token [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:05:38.401918 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e555c6f9c0 pid: 100863 (default app) Nov 21 17:05:38.404100 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:05:38.405305 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Nov 21 17:05:38.405718 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Sun Nov 21 17:05:38 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:05:38.447085 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: WARNING keystonemiddleware.auth_token [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:05:38.452924 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: WARNING keystonemiddleware.auth_token [None req-3bd17ea4-2602-433e-9072-ea1a7147eb7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:05:38.458079 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e555c6f9c0 pid: 100864 (default app) Nov 21 17:07:04.477450 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:04.478583 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 21 17:07:04.478999 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:05.249815 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a8934f25-34d3-4694-92d1-0ac5c02b8dbc admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:05.308939 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a8934f25-34d3-4694-92d1-0ac5c02b8dbc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.820831 Nov 21 17:07:05.316025 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Sun Nov 21 17:07:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:07.813829 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:07.815568 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-af84576d-e8f4-4a9b-8a68-70b6917821cb None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002554 Nov 21 17:07:07.816341 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:07 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:07.926978 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-980f967d-e205-40f4-9571-bd4f6b288af3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:07.964250 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:07:07.964250 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:07:08.014750 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-980f967d-e205-40f4-9571-bd4f6b288af3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.184652 Nov 21 17:07:08.015958 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:07:08.453743 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-119d5aea-8911-4fd2-b3c4-ab6fa3d54df7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:08.457713 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:07:08.457713 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: warnings.warn(msg) Nov 21 17:07:08.535523 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-119d5aea-8911-4fd2-b3c4-ab6fa3d54df7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.505234 Nov 21 17:07:08.536709 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Sun Nov 21 17:07:08 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:07:10.902673 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-980f967d-e205-40f4-9571-bd4f6b288af3 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:10.903755 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-980f967d-e205-40f4-9571-bd4f6b288af3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Nov 21 17:07:10.904458 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:11.062155 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-1b12413d-667b-4f2f-bebf-dfd30b3c1043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:11.085789 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:07:11.085789 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: warnings.warn(msg) Nov 21 17:07:11.109060 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-1b12413d-667b-4f2f-bebf-dfd30b3c1043 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.197739 Nov 21 17:07:11.109845 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:11.128484 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-7249a34f-322c-4ff8-9ecd-a634346c8f7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:11.130504 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:07:11.130504 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:07:11.168964 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-7249a34f-322c-4ff8-9ecd-a634346c8f7c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044428 Nov 21 17:07:11.169793 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Sun Nov 21 17:07:11 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:13.557232 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-1b12413d-667b-4f2f-bebf-dfd30b3c1043 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:13.559394 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-1b12413d-667b-4f2f-bebf-dfd30b3c1043 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002323 Nov 21 17:07:13.560562 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:13 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:13.643521 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-c39d7361-7e42-4abb-9268-e483a012843e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:13.671152 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-c39d7361-7e42-4abb-9268-e483a012843e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103241 Nov 21 17:07:13.671836 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:07:13.688618 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-6bd0f3bf-6a5f-4209-be5b-604ba97702e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:13.724114 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-6bd0f3bf-6a5f-4209-be5b-604ba97702e0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042066 Nov 21 17:07:13.726402 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Sun Nov 21 17:07:13 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:16.171906 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-c39d7361-7e42-4abb-9268-e483a012843e admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:16.173518 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-c39d7361-7e42-4abb-9268-e483a012843e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Nov 21 17:07:16.174368 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:16.238043 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-31ffa5d8-2a26-4a0d-a57a-cf65e2c88df3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "disk": 10}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:16.257278 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-31ffa5d8-2a26-4a0d-a57a-cf65e2c88df3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075544 Nov 21 17:07:16.257864 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:07:16.274241 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-f757660f-f4f1-454a-a1f7-d8638088741f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:16.298301 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-f757660f-f4f1-454a-a1f7-d8638088741f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030701 Nov 21 17:07:16.298917 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Sun Nov 21 17:07:16 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:18.634718 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-31ffa5d8-2a26-4a0d-a57a-cf65e2c88df3 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:18.635812 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-31ffa5d8-2a26-4a0d-a57a-cf65e2c88df3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Nov 21 17:07:18.642368 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:18 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:18.710129 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:18.747153 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101834 Nov 21 17:07:18.749245 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:18.765739 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-d7fd0b8e-e916-475a-807b-9ace943bab5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:18.799897 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-d7fd0b8e-e916-475a-807b-9ace943bab5f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039943 Nov 21 17:07:18.800778 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Sun Nov 21 17:07:18 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:07:21.161592 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:21.164664 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003787 Nov 21 17:07:21.165340 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:21 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:21.251871 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-e883da21-3b93-467d-a36f-8f30bb39ae32 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:21.276368 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-e883da21-3b93-467d-a36f-8f30bb39ae32 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.099678 Nov 21 17:07:21.276899 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Sun Nov 21 17:07:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:07:23.576826 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:23.577830 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-1632cffc-467b-41c6-93af-869bd735b1c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Nov 21 17:07:23.578251 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:07:23.653847 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-3199eecf-d80f-4113-b490-cf1a7ca16dcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "id": "1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:23.682239 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-3199eecf-d80f-4113-b490-cf1a7ca16dcd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.094574 Nov 21 17:07:23.683179 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:23 2021] POST /compute/v2.1/flavors => generated 402 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:23.700825 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-4c10e5ad-72b5-481e-bc90-a26797266a8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:23.736521 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-4c10e5ad-72b5-481e-bc90-a26797266a8e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040452 Nov 21 17:07:23.737758 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Sun Nov 21 17:07:23 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:26.279036 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-3199eecf-d80f-4113-b490-cf1a7ca16dcd admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:26.280084 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-3199eecf-d80f-4113-b490-cf1a7ca16dcd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Nov 21 17:07:26.280501 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:26.348194 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-6ba0827d-3f0d-4eda-b55d-4c8f28188653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:26.369219 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-6ba0827d-3f0d-4eda-b55d-4c8f28188653 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081625 Nov 21 17:07:26.369784 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:26.383310 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-e7ff3481-358d-4e90-9dbd-67f7b030299c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:26.409385 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-e7ff3481-358d-4e90-9dbd-67f7b030299c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030434 Nov 21 17:07:26.410554 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Sun Nov 21 17:07:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:07:28.688670 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-6ba0827d-3f0d-4eda-b55d-4c8f28188653 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:28.689673 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-6ba0827d-3f0d-4eda-b55d-4c8f28188653 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 21 17:07:28.690083 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:28.764064 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-576a2cc5-68c2-44c8-a157-d70577f1b331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:28.783806 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-576a2cc5-68c2-44c8-a157-d70577f1b331 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086204 Nov 21 17:07:28.784363 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:28 2021] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:28.801520 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-8f7097a6-19a3-4d7d-afa9-3f17d3993a8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:28.835116 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-8f7097a6-19a3-4d7d-afa9-3f17d3993a8a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041243 Nov 21 17:07:28.835697 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Sun Nov 21 17:07:28 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:31.233702 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-576a2cc5-68c2-44c8-a157-d70577f1b331 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:31.235340 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-576a2cc5-68c2-44c8-a157-d70577f1b331 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Nov 21 17:07:31.235744 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:31.320623 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-4bc3f2ea-3931-43b3-9b45-e4c83d12ff9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:31.342086 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-4bc3f2ea-3931-43b3-9b45-e4c83d12ff9f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.098723 Nov 21 17:07:31.342655 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:07:31.355812 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-1600a9c0-910e-4cb2-8985-ea8c2c2f5fc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:31.383321 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-1600a9c0-910e-4cb2-8985-ea8c2c2f5fc0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031086 Nov 21 17:07:31.384279 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Sun Nov 21 17:07:31 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:07:33.729176 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-4bc3f2ea-3931-43b3-9b45-e4c83d12ff9f admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:07:33.730277 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-4bc3f2ea-3931-43b3-9b45-e4c83d12ff9f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Nov 21 17:07:33.730717 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:07:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:07:33.805587 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:33.826477 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088308 Nov 21 17:07:33.827441 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Sun Nov 21 17:07:33 2021] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:07:33.841026 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-bba71f5b-46f3-4458-ae90-508ff4ff0327 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:07:33.873600 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-bba71f5b-46f3-4458-ae90-508ff4ff0327 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035757 Nov 21 17:07:33.875187 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Sun Nov 21 17:07:33 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:08:13.675981 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:13.676978 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 21 17:08:13.677385 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:08:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:13.737785 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-ea353d82-fe03-4523-a0a5-963813a3286e admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:13.754934 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-ea353d82-fe03-4523-a0a5-963813a3286e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070571 Nov 21 17:08:13.755474 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Sun Nov 21 17:08:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:08:15.218235 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:15.219343 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-0e90c760-e3b2-4b45-b507-f2cbef5792bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Nov 21 17:08:15.219744 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:15.417596 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-9c868e8e-1e7b-45fa-bdaa-6d454caa3a69 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:15.423275 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.wsgi [None req-9c868e8e-1e7b-45fa-bdaa-6d454caa3a69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 21 17:08:15.423775 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-9c868e8e-1e7b-45fa-bdaa-6d454caa3a69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:15.424566 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-9c868e8e-1e7b-45fa-bdaa-6d454caa3a69 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063121 Nov 21 17:08:15.425097 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Sun Nov 21 17:08:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:15.438851 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-159920ef-9014-4bde-8ab0-af1ffe3a9a23 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:15.466399 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-159920ef-9014-4bde-8ab0-af1ffe3a9a23 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033814 Nov 21 17:08:15.466957 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:08:15.479528 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-0b9a812b-1839-4514-9986-b39f3cc53bf7 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:15.504916 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-0b9a812b-1839-4514-9986-b39f3cc53bf7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030236 Nov 21 17:08:15.505591 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:08:15.516332 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-58c2873f-6f3c-4557-b6bf-dec276a9bb46 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:15.523551 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.wsgi [None req-58c2873f-6f3c-4557-b6bf-dec276a9bb46 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 21 17:08:15.524129 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-58c2873f-6f3c-4557-b6bf-dec276a9bb46 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:15.524934 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-58c2873f-6f3c-4557-b6bf-dec276a9bb46 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.012202 Nov 21 17:08:15.525450 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Sun Nov 21 17:08:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:16.966401 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-0b9a812b-1839-4514-9986-b39f3cc53bf7 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:16.967451 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-0b9a812b-1839-4514-9986-b39f3cc53bf7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Nov 21 17:08:16.967876 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:17.160157 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-24aff24b-25b0-4aab-a04f-8f0a658a8544 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:17.166762 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.wsgi [None req-24aff24b-25b0-4aab-a04f-8f0a658a8544 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 21 17:08:17.167323 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-24aff24b-25b0-4aab-a04f-8f0a658a8544 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:17.168140 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-24aff24b-25b0-4aab-a04f-8f0a658a8544 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060956 Nov 21 17:08:17.168641 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Sun Nov 21 17:08:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:17.178590 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-39927d78-ff1c-4198-b99b-6e48dccbb152 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:17.193167 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-39927d78-ff1c-4198-b99b-6e48dccbb152 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018082 Nov 21 17:08:17.193706 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:08:17.204214 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-062b6217-b52f-45ec-82ed-a7a25c2fbc16 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:17.217978 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-062b6217-b52f-45ec-82ed-a7a25c2fbc16 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017278 Nov 21 17:08:17.218509 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:08:17.228861 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-ffd1f3ef-5963-437f-a479-f0ec1ba1d629 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:17.233996 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.wsgi [None req-ffd1f3ef-5963-437f-a479-f0ec1ba1d629 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 21 17:08:17.234549 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-ffd1f3ef-5963-437f-a479-f0ec1ba1d629 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:17.235354 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-ffd1f3ef-5963-437f-a479-f0ec1ba1d629 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010618 Nov 21 17:08:17.235873 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Sun Nov 21 17:08:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:18.606182 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-062b6217-b52f-45ec-82ed-a7a25c2fbc16 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:18.607234 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-062b6217-b52f-45ec-82ed-a7a25c2fbc16 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 21 17:08:18.607620 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:18.798483 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-b0764f00-8980-4b88-9093-d85388243398 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:18.805080 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.wsgi [None req-b0764f00-8980-4b88-9093-d85388243398 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 21 17:08:18.805648 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-b0764f00-8980-4b88-9093-d85388243398 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:18.806451 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-b0764f00-8980-4b88-9093-d85388243398 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061591 Nov 21 17:08:18.810433 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:08:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:18.817218 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-e8500687-731d-4ba8-938c-1a810c6be2bc admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:18.832078 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-e8500687-731d-4ba8-938c-1a810c6be2bc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018405 Nov 21 17:08:18.832998 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:08:18.843767 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:18.858261 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017970 Nov 21 17:08:18.859045 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Sun Nov 21 17:08:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:08:18.869799 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-728cb10f-219c-4bbf-adbf-50e85bde9723 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:18.875590 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.wsgi [None req-728cb10f-219c-4bbf-adbf-50e85bde9723 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 21 17:08:18.876242 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-728cb10f-219c-4bbf-adbf-50e85bde9723 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:08:18.877150 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-728cb10f-219c-4bbf-adbf-50e85bde9723 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011519 Nov 21 17:08:18.877758 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:08:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 21 17:08:20.269686 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:20.270730 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Nov 21 17:08:20.271136 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:08:20.467358 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-01346fbd-a38f-4b76-adb0-1ce0a483f690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:08:20.486756 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-01346fbd-a38f-4b76-adb0-1ce0a483f690 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075216 Nov 21 17:08:20.487156 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Sun Nov 21 17:08:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:08:21.863470 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:21.864479 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 21 17:08:21.864869 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:22.058748 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-70be9030-772f-4dc1-8ead-a436d85b45c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:08:22.076749 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-70be9030-772f-4dc1-8ead-a436d85b45c7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071158 Nov 21 17:08:22.077303 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Sun Nov 21 17:08:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:08:23.469503 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:23.470695 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 21 17:08:23.471173 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:23.669260 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-fc585ec3-89e5-4431-9e1c-6feedd251a5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:08:23.688938 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-fc585ec3-89e5-4431-9e1c-6feedd251a5f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074598 Nov 21 17:08:23.689392 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Sun Nov 21 17:08:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:08:25.077264 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:25.078258 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 21 17:08:25.078678 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:25.271992 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-ad342c26-d252-4134-94c7-1390fa9811b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:08:25.290870 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-ad342c26-d252-4134-94c7-1390fa9811b1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072040 Nov 21 17:08:25.291329 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Sun Nov 21 17:08:25 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:08:26.664504 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:26.665511 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Nov 21 17:08:26.665918 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:08:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:08:26.860505 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-908882bf-2a9b-490f-99db-161282c6056b admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:08:26.879700 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-908882bf-2a9b-490f-99db-161282c6056b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072423 Nov 21 17:08:26.880172 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Sun Nov 21 17:08:26 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:09:12.720883 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.721873 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a95ac27c-d904-4d0b-9ba0-3610da8ff5e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 21 17:09:12.722269 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:09:12.780937 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-9278f51a-1970-48c2-bd7c-9ef26b3e4fad admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.800515 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-9278f51a-1970-48c2-bd7c-9ef26b3e4fad admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070775 Nov 21 17:09:12.801041 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:09:12.824588 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-5cbab81c-cbda-461d-9109-e8f9c11ac4fd admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.832251 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-5cbab81c-cbda-461d-9109-e8f9c11ac4fd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011581 Nov 21 17:09:12.832781 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:09:12.845369 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-959f54bc-d70f-4141-8e25-169fce4265ba admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.854023 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-959f54bc-d70f-4141-8e25-169fce4265ba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012273 Nov 21 17:09:12.854568 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:09:12.867476 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-c3bdbdc1-d567-4d72-956f-cab97dbf8cd1 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.875121 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-c3bdbdc1-d567-4d72-956f-cab97dbf8cd1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Nov 21 17:09:12.875643 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:09:12.888075 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:09:12.895736 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011399 Nov 21 17:09:12.896251 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Sun Nov 21 17:09:12 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:10:36.552295 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-5c0d03b3-c6a3-4ac3-8075-d6df11783144 tempest-verify_tempest_config-1665123824 tempest-verify_tempest_config-1665123824-project] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:10:36.554890 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-5c0d03b3-c6a3-4ac3-8075-d6df11783144 tempest-verify_tempest_config-1665123824 tempest-verify_tempest_config-1665123824-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106744 Nov 21 17:10:36.555424 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1133 bytes} [Sun Nov 21 17:10:36 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:12:03.068930 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:03.069928 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 21 17:12:03.070326 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 36/70] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:12:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:12:03.341524 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:03.342755 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:12:03.342755 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:12:03.344326 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:03.344763 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:03.345540 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:03.345956 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:03.380010 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-eebac845-579f-4657-8155-7d7be43659d9 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157509 Nov 21 17:12:03.380574 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 35/71] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:12:03 2021] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:12:04.768957 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:04.769957 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 21 17:12:04.770354 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 37/72] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:12:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:12:04.965884 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:04.967113 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:12:04.967113 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:12:04.968624 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:04.969063 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:04.969833 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:04.970255 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:04.989446 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-3fca24d0-e74e-456f-987f-c8dba0078e53 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076087 Nov 21 17:12:04.989931 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 36/73] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:12:04 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:12:16.789924 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:16.790931 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Nov 21 17:12:16.791323 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 38/74] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:12:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:12:16.985704 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:16.986941 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:12:16.986941 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:12:16.988429 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:16.988863 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:16.989718 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:16.990081 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:17.014639 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-15a8130e-8bbb-4054-9951-ce0a5f527d7c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081422 Nov 21 17:12:17.015207 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:12:16 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:12:18.402767 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: DEBUG nova.api.openstack.wsgi [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] Calling method '>' {{(pid=100863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:18.403688 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: INFO nova.api.openstack.requestlog [None req-80937614-d3b0-4a30-ba99-f327cb0f3cd1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Nov 21 17:12:18.404072 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: [pid: 100863|app: 0|req: 39/76] 10.222.0.52 () {56 vars in 1074 bytes} [Sun Nov 21 17:12:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:12:18.594165 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG nova.api.openstack.wsgi [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] Calling method '>' {{(pid=100864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:12:18.595348 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:12:18.595348 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: warnings.warn(msg) Nov 21 17:12:18.596833 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:18.597260 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:18.598027 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:12:18.598438 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: DEBUG oslo_concurrency.lockutils [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:12:18.619286 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: INFO nova.api.openstack.requestlog [None req-a5d2380d-023d-48f8-aba4-2e71c9127cae admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076727 Nov 21 17:12:18.619751 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: [pid: 100864|app: 0|req: 38/77] 10.222.0.52 () {60 vars in 1193 bytes} [Sun Nov 21 17:12:18 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:13:17.393511 dv-cinder-818696-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 21 17:13:17.394440 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: Sun Nov 21 17:13:17 2021 - graceful shutdown triggered... Nov 21 17:13:17.394931 dv-cinder-818696-2-iscsi devstack@n-api.service[100863]: Gracefully killing worker 1 (pid: 100863)... Nov 21 17:13:17.395317 dv-cinder-818696-2-iscsi devstack@n-api.service[100864]: Gracefully killing worker 2 (pid: 100864)... Nov 21 17:13:18.394781 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: worker 1 buried after 1 seconds Nov 21 17:13:18.394781 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: worker 2 buried after 1 seconds Nov 21 17:13:18.394781 dv-cinder-818696-2-iscsi devstack@n-api.service[100862]: goodbye to uWSGI. Nov 21 17:13:18.396370 dv-cinder-818696-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 21 17:13:18.396922 dv-cinder-818696-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 21 17:13:18.399828 dv-cinder-818696-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 21 17:13:18.410506 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Nov 21 17:13:18 2021] *** Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: nodename: dv-cinder-818696-2-iscsi Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: machine: x86_64 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: clock source: unix Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: pcre jit disabled Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: detected number of CPU cores: 4 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: current working directory: / Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: detected binary path: /usr/bin/uwsgi-core Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: your processes number limit is 47680 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: your memory page size is 4096 bytes Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: detected max file descriptor number: 2048 Nov 21 17:13:18.412653 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: lock engine: pthread robust mutexes Nov 21 17:13:18.413563 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: thunder lock: enabled Nov 21 17:13:18.413563 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 21 17:13:18.413563 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 21 17:13:18.458107 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: Python main interpreter initialized at 0x56146b71e9c0 Nov 21 17:13:18.458107 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: python threads support enabled Nov 21 17:13:18.458107 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: your server socket listen backlog is limited to 100 connections Nov 21 17:13:18.458107 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: your mercy for graceful operations on workers is 90 seconds Nov 21 17:13:18.458566 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: mapped 403077 bytes (393 KB) for 2 cores Nov 21 17:13:18.458566 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: *** Operational MODE: preforking *** Nov 21 17:13:18.458867 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: *** uWSGI is running in multiple interpreter mode *** Nov 21 17:13:18.458867 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: spawned uWSGI master process (pid: 115836) Nov 21 17:13:18.459109 dv-cinder-818696-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 21 17:13:18.459674 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: spawned uWSGI worker 1 (pid: 115853, cores: 1) Nov 21 17:13:18.460040 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: spawned uWSGI worker 2 (pid: 115854, cores: 1) Nov 21 17:13:18.460198 dv-cinder-818696-2-iscsi devstack@n-api.service[115836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 21 17:13:20.299744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:13:20.299744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: from cryptography.utils import int_from_bytes Nov 21 17:13:20.300440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:13:20.300440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: from cryptography.utils import int_from_bytes Nov 21 17:13:20.313567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:13:20.313567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: from cryptography.utils import int_from_bytes Nov 21 17:13:20.314183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 21 17:13:20.314183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: from cryptography.utils import int_from_bytes Nov 21 17:13:23.040476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 17:13:23.041145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 17:13:23.041236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 17:13:23.041556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 17:13:23.041817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 17:13:23.042209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.042543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.042895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.043221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.043557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.043879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.044214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.044540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.044909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.045137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.045722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.046170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818696-2-iscsi {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.046505 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.046850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.047168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.047495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.047808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.048133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.048445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.048872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 21 17:13:23.049285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.049378 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 21 17:13:23.049458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.049642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 21 17:13:23.049740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.049983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 21 17:13:23.050089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.050252 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 21 17:13:23.050358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.050652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.050765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.050960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.051924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818696-2-iscsi {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.052967 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.053206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.053307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.053470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.053564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.053794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818696-2-iscsi {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.054929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.055851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056714 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.056908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.057981 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058162 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.058928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059145 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.059877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818696-2-iscsi {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.060939 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.061730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.061834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.062166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.062484 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.062583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.062830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.063837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064046 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.064774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065010 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065649 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.065960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.066919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067650 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.067974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.068857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.069916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070591 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.070894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.071918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.072825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073655 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.073965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074375 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.074929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.075973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.076193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.076285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.076500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.076600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.077677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.077993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.078307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.078462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.078604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.078750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.078986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.079953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.080932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.081877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082199 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082732 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.082840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.083963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084269 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.084979 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.085907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086451 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.086896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.087818 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.088040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.088135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.088348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.088445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.088658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.088764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.088981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.089083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.089287 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.089389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.089596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.089697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.089917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.090017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.090228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.090321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.090536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.090649 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.090909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.091011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.091226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.091326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.091534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.091627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.091857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.091960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.092166 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.092315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.092565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.092890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.093080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.093220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.093369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.093508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.093686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.093822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.094000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.094148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.094315 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.094486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.094656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.094834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.094962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.095153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.095274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.095504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.095652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.095852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.095954 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.096172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.096271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.096505 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.096599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.096811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.096903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.097136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 21 17:13:23.097245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.097450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.097556 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.097769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.097862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098087 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098181 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.098851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099075 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.099838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100149 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.100788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.101944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.102932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.103990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104522 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.104940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105472 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.105880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106427 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106765 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.106874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.107801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.108546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.108865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.108958 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.109932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.110952 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.111909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.112847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.113999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114097 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.114956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115578 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.115991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.116207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.116307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.116518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.116830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.117927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.118966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.119891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.120847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121711 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.121810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.122789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.123012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.123143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.123321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.123420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.124185 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.124536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.124879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.125207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.125539 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.125855 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.126177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.126492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.126834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.127152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.127468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.127791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.128106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.128432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.128749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.129080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.129394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.129718 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.130027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.130344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.130707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131635 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.131977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.132925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133273 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.133935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134484 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.134935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.135891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136517 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.136865 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137553 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137714 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.137882 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.138890 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.139974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.140188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.140292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.140617 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.140934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.141248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.141570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.141899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.142216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.142537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.142881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.143223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.143593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.143954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.144274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.144514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.144621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.144900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145534 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.145966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.146972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.147166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.147329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.147482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.147667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.147807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148009 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.148996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.149969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150631 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.150963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151380 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.151915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.152949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.153926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154110 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.154907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.155856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.156799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.157949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158264 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.158912 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159342 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.159973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.160931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.161869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.162865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163122 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163448 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.163974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.164932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.165980 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.166214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.166485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.166632 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.166857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.167116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.167219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.167478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.167706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.167800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168205 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.168836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169675 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.169995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.170096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.170313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171753 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.171845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.172814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.173780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.174969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.175909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176836 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.176940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.177861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.178823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179424 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.179940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180268 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.180984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.181256 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.181363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.181570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.181671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.181910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.182979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.183121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.183463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.183590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.183787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.184030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.184360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.184493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.184681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185286 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.185842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.186099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.186884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.186994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.187334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.187475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.187672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.187999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.188955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.189126 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.189276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.189454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.189598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.189917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.190036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.190222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.190533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.190663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.190873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191573 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.191910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192071 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192517 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.192969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193494 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.193956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.194099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.194255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.194397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.194554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.194815 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195662 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.195806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.196951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.197933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.198991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199517 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.199933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.200855 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.201999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.202108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.202582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.202817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.202959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.203949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.204986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.205964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.206163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.206289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.206480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.206586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.206821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.207785 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.208988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209398 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.209929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210327 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.210902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.211998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212656 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.212993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.213950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.214943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215360 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.215993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.216969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.217161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.217328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.217611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.217722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.217927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.218938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219279 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.219931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.220213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.220365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.220652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.220781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.220918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221066 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.221915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.222079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.222353 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.222487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.222718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.222835 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223478 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.223807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.224117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.224227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.224432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.224741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.224840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.225922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.226128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.226339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.226497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.226704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.226806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.227917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.228873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.229975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.230154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.230297 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.230487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.230607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.230832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.231794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232030 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232465 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.232769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.233487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.233638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.233802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234069 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.234875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235164 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235522 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.235796 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236637 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.236963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.237910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.238888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.239906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240124 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.240854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.241813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242398 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242703 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.242801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243038 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.243791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244324 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.244948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.245878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.246938 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.247884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.248105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.248198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.248415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.248670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.249299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.249446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.249586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.249688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.249890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.250988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.251931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.252254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.252360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.252477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.252676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.252808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.253808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.254792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255650 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.255966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256280 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.256929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257270 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.257920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.258135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.258367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.258483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.258760 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.258859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.259821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260035 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.260993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261411 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.261950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262371 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.262921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263022 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.263964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.264207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.264344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.264543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.264757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.264924 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.265892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266211 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.266864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.267807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268745 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.268971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269075 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.269943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.270971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.271941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.272929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.273081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.273395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.273494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.273705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.273808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274032 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.274915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275550 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.275906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276270 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.276904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.277856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278385 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.278819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279130 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.279787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280822 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.280906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.281835 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.282930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283032 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.283916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.284014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.284226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.284500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.284635 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.284842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.285888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.286040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.286230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.286400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.286656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.286804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.287008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.287294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.287451 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.287593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.287902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.288106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.288300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.288466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.288614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.288833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.289064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.289217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.289453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.289619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.289797 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.290123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.290355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.290614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.290947 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.291146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.291357 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.291549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.291749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.291945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.292141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.292333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.292552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.292753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.292944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.293134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.293320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.293524 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.293718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.293902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.294093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.294319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.294501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.294791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.294971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.295135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.295326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296026 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.296994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.297193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.297381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.297609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.297808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298004 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.298961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.299940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.300230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.300326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.300572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.300849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.300947 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.301223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.301325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.301537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.301642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.301955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302373 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.302961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.303930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.304990 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.305234 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.305326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.305581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.305674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.305914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.306036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.306282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.306598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.306779 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.306899 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.307053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 17:13:23.307194 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.307382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.307698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.308046 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.308371 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.308703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.309021 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.309350 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.309666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.309996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.310325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.310676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.311000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.311916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.312228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.312548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.312868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.313191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.313507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.313822 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.314150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.314482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.314820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.315154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.315478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.315804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.316125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.316439 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.316778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.317094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.317414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.318063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.318464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.318823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.319147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.319483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.319815 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.320146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.320480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.320833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.321151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.321499 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.321833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 21 17:13:23.322083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 21 17:13:23.336251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_db.sqlalchemy.engines [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.347251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_db.sqlalchemy.engines [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.429690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.context [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),30be9fce-2665-48f2-b5e2-b49d52c4b8ef(cell1) {{(pid=115853) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 17:13:23.435000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:13:23.435592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.context [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),30be9fce-2665-48f2-b5e2-b49d52c4b8ef(cell1) {{(pid=115854) load_cells /opt/stack/nova/nova/context.py:464}} Nov 21 17:13:23.437415 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:13:23.438312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:13:23.440421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:13:23.440988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:13:23.442658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:13:23.443544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:13:23.445661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:13:23.454951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_db.sqlalchemy.engines [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.456554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_db.sqlalchemy.engines [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.461778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_db.sqlalchemy.engines [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.465779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_db.sqlalchemy.engines [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.767214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_db.sqlalchemy.engines [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:23.783883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_db.sqlalchemy.engines [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 21 17:13:24.149291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: WARNING keystonemiddleware.auth_token [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:13:24.149853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: WARNING keystonemiddleware.auth_token [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:13:24.157901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: WARNING keystonemiddleware.auth_token [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:13:24.159793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: WARNING keystonemiddleware.auth_token [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:13:24.515871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: WARNING keystonemiddleware.auth_token [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:13:24.521136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: WARNING keystonemiddleware.auth_token [None req-c9396d38-0177-41d8-96d0-2367722ad3ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:13:24.526342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56146b71e9c0 pid: 115854 (default app) Nov 21 17:13:24.530774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: WARNING keystonemiddleware.auth_token [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 21 17:13:24.536042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: WARNING keystonemiddleware.auth_token [None req-f4760e5a-af10-407f-84fd-493bf7574dad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 21 17:13:24.541184 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56146b71e9c0 pid: 115853 (default app) Nov 21 17:14:06.897932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1032e48d-456b-45c9-85b4-89e9d31090ea tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Action: 'create', calling method: .version_select at 0x7f1fbf739940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1408295500"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:07.771378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41b5d066-364a-433b-ac86-edc58fceb0be tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Action: 'create', calling method: .version_select at 0x7f1fbf73a940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-388920581", "metadata": {"Type": "work"}}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:07.774431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41b5d066-364a-433b-ac86-edc58fceb0be tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:07.793766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-41b5d066-364a-433b-ac86-edc58fceb0be tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.762467 Nov 21 17:14:07.809588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Sun Nov 21 17:14:06 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1781 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 17:14:07.937901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4be121ed-f41e-4dc5-8f7f-11b83bb81694 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Action: 'create', calling method: .version_select at 0x7f1fbf6bb4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-899935656", "metadata": {"Type": "work"}}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:08.065399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1032e48d-456b-45c9-85b4-89e9d31090ea tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.735312 Nov 21 17:14:08.082138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1154 bytes} [Sun Nov 21 17:14:05 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2755 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 21 17:14:08.089251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-09f0f2aa-038c-4e8e-90a7-7d7b1dfee95b tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Action: 'create', calling method: .version_select at 0x7f1fbf6b04c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1815620042", "metadata": {"Type": "work"}}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:08.095522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-09f0f2aa-038c-4e8e-90a7-7d7b1dfee95b tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:08.096675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-09f0f2aa-038c-4e8e-90a7-7d7b1dfee95b tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013035 Nov 21 17:14:08.097349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1155 bytes} [Sun Nov 21 17:14:08 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 17:14:08.112816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-720d2980-003a-4a7f-baee-9c9222b59e0d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbffe2d30>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:08.232608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-720d2980-003a-4a7f-baee-9c9222b59e0d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 200 len: 345 microversion: 2.1 time: 0.133020 Nov 21 17:14:08.233484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:08 2021] GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:08.244311 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-30f16741-35b7-4238-b6f7-56b8dd0d2957 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Action: 'create', calling method: .version_select at 0x7f1fbf604700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1650826271", "metadata": {"Type": "work"}}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:08.246739 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-30f16741-35b7-4238-b6f7-56b8dd0d2957 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:08.250381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-30f16741-35b7-4238-b6f7-56b8dd0d2957 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008158 Nov 21 17:14:08.252180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 4/5] 10.222.0.52 () {60 vars in 1155 bytes} [Sun Nov 21 17:14:08 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 17:14:08.264778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e1d08b1f-d162-406c-a16d-07e8ea3924f6 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Calling method '.version_select at 0x7f1fbf61f940>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:08.345455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-e1d08b1f-d162-406c-a16d-07e8ea3924f6 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] HTTP exception thrown: Volume tempest-invalid-1109228685 could not be found. Nov 21 17:14:08.346257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e1d08b1f-d162-406c-a16d-07e8ea3924f6 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 404 to user: Volume tempest-invalid-1109228685 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:08.347555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e1d08b1f-d162-406c-a16d-07e8ea3924f6 tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1109228685" status: 404 len: 99 microversion: 2.1 time: 0.089516 Nov 21 17:14:08.348630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 5/6] 10.222.0.52 () {58 vars in 1217 bytes} [Sun Nov 21 17:14:08 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1109228685 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 21 17:14:08.353577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3cb64196-eae0-4754-9583-3e779c3cca25 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbf604e50>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:08.428553 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3cb64196-eae0-4754-9583-3e779c3cca25 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f7294e68-c911-4542-8af5-0ceaa85c3d8e" status: 200 len: 351 microversion: 2.1 time: 0.078346 Nov 21 17:14:08.429245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 6/7] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:08 2021] GET /compute/v2.1/os-volumes/f7294e68-c911-4542-8af5-0ceaa85c3d8e => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:08.436540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fc5d4f25-a4f4-4c08-a3dd-afe6bf90319c tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004121 Nov 21 17:14:08.439708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 7/8] 10.222.0.52 () {58 vars in 1139 bytes} [Sun Nov 21 17:14:08 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 21 17:14:08.453820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7eefe202-b5ed-4582-8d48-3ca7fb080c9a tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008059 Nov 21 17:14:08.455548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 8/9] 10.222.0.52 () {58 vars in 1136 bytes} [Sun Nov 21 17:14:08 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 21 17:14:08.465627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a5e15f5f-7444-4d03-9032-953933bf4c5c tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Calling method '.version_select at 0x7f1fbfc54e50>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:09.067518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-a5e15f5f-7444-4d03-9032-953933bf4c5c tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] HTTP exception thrown: Volume ec2aed24-f050-4eee-ace6-a9521fb33578 could not be found. Nov 21 17:14:09.069108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a5e15f5f-7444-4d03-9032-953933bf4c5c tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 404 to user: Volume ec2aed24-f050-4eee-ace6-a9521fb33578 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:09.070178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a5e15f5f-7444-4d03-9032-953933bf4c5c tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/ec2aed24-f050-4eee-ace6-a9521fb33578" status: 404 len: 109 microversion: 2.1 time: 0.608955 Nov 21 17:14:09.072536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:14:08 2021] DELETE /compute/v2.1/os-volumes/ec2aed24-f050-4eee-ace6-a9521fb33578 => generated 109 bytes in 612 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:09.083682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4b64f128-89f8-4d5c-a5eb-891d487ffebd tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Calling method '.version_select at 0x7f1fbf6049d0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:09.268546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-4b64f128-89f8-4d5c-a5eb-891d487ffebd tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] HTTP exception thrown: Volume df2b4ee4-662d-4a1b-b2f5-7df6b5c63f3a could not be found. Nov 21 17:14:09.269284 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4b64f128-89f8-4d5c-a5eb-891d487ffebd tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] Returning 404 to user: Volume df2b4ee4-662d-4a1b-b2f5-7df6b5c63f3a could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:09.270437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4b64f128-89f8-4d5c-a5eb-891d487ffebd tempest-VolumesNegativeTest-1805853699 tempest-VolumesNegativeTest-1805853699-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/df2b4ee4-662d-4a1b-b2f5-7df6b5c63f3a" status: 404 len: 109 microversion: 2.1 time: 0.191583 Nov 21 17:14:09.271446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 10/11] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:09 2021] GET /compute/v2.1/os-volumes/df2b4ee4-662d-4a1b-b2f5-7df6b5c63f3a => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:09.278199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f1dbd4e5-c8a3-4699-9d9f-6abdfddc7d83 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbff9b040>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:09.295445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4be121ed-f41e-4dc5-8f7f-11b83bb81694 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.482676 Nov 21 17:14:09.296248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 2/12] 10.222.0.52 () {60 vars in 1155 bytes} [Sun Nov 21 17:14:07 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1486 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 21 17:14:09.308924 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-01e43577-096d-4ec9-b7b8-f0a9abf5ef0d tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf60e9d0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:09.457187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f1dbd4e5-c8a3-4699-9d9f-6abdfddc7d83 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 200 len: 346 microversion: 2.1 time: 0.184432 Nov 21 17:14:09.458890 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 11/13] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:09 2021] GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:09.472488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d3f013bb-1cc5-4441-ab15-834731546feb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Action: 'create', calling method: .version_select at 0x7f1fbffe2dc0>, body: {"snapshot": {"volume_id": "8690df1e-47cc-4e2f-9d33-00137c0885c6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1981039160"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:09.588825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-01e43577-096d-4ec9-b7b8-f0a9abf5ef0d tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 200 len: 352 microversion: 2.1 time: 0.283934 Nov 21 17:14:09.589396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 3/14] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:09 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:09.959222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d3f013bb-1cc5-4441-ab15-834731546feb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.493203 Nov 21 17:14:09.959809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 12/15] 10.222.0.52 () {60 vars in 1161 bytes} [Sun Nov 21 17:14:09 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:09.970272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e4a29009-043b-4971-a20a-168aa3b54909 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf61e280>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.074106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e4a29009-043b-4971-a20a-168aa3b54909 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 287 microversion: 2.1 time: 0.108076 Nov 21 17:14:10.074836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 4/16] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:09 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:10.087518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-50342fc6-71bb-430f-9df3-e61a0cf6086c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf61eca0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.173455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-50342fc6-71bb-430f-9df3-e61a0cf6086c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089493 Nov 21 17:14:10.174519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 5/17] 10.222.0.52 () {58 vars in 1139 bytes} [Sun Nov 21 17:14:10 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:10.189104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-748714c6-7514-4081-9e47-f8a5859fdeae tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf61edc0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.308467 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-748714c6-7514-4081-9e47-f8a5859fdeae tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 287 microversion: 2.1 time: 0.124108 Nov 21 17:14:10.309634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-792202959", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "0ca8b2fb-1bb5-4757-9d3e-b00d10b603de"}]}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:10.311997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 6/18] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:10 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:14:10.447668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] validate_networks() for [('0ca8b2fb-1bb5-4757-9d3e-b00d10b603de', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:14:10.567076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-70c97b50-7b93-4c14-9c24-a3f51faa2ef0 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbf61e4c0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.686221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-70c97b50-7b93-4c14-9c24-a3f51faa2ef0 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/fb8ce5e0-f6f5-4db1-b737-cca1e7e07768" status: 200 len: 351 microversion: 2.1 time: 0.122798 Nov 21 17:14:10.697721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 7/19] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:10 2021] GET /compute/v2.1/os-volumes/fb8ce5e0-f6f5-4db1-b737-cca1e7e07768 => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:10.702599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c9aa6bd8-c147-4da6-bf97-8bb20ac13d3a tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf60ea60>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.842763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c9aa6bd8-c147-4da6-bf97-8bb20ac13d3a tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 200 len: 353 microversion: 2.1 time: 0.143906 Nov 21 17:14:10.843612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 8/20] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:10 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:10.858857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7428fc65-6cbb-4ebe-8e5d-868347f9b806 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf60e9d0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:10.934307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7428fc65-6cbb-4ebe-8e5d-868347f9b806 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 200 len: 353 microversion: 2.1 time: 0.078963 Nov 21 17:14:10.936241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 9/21] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:10 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:10.984378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-10fecdb5-4a27-473f-8d9b-dd035d858ec9 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf61e1f0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:11.086617 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-10fecdb5-4a27-473f-8d9b-dd035d858ec9 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 202 len: 0 microversion: 2.1 time: 0.109098 Nov 21 17:14:11.087534 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 10/22] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:14:10 2021] DELETE /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:14:11.095915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-00e38a10-343a-438d-844d-0c29bde9310d tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf61e820>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:11.254940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-00e38a10-343a-438d-844d-0c29bde9310d tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 200 len: 352 microversion: 2.1 time: 0.162920 Nov 21 17:14:11.256081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:11 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:14:11.326637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-98f5ae76-dbd2-42cb-aa01-4f97886c50f2 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf60ec10>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:11.383705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-98f5ae76-dbd2-42cb-aa01-4f97886c50f2 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 287 microversion: 2.1 time: 0.061994 Nov 21 17:14:11.384896 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:11 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:12.197200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1946039171", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "3e685649-08ee-406b-ab8b-0039878e0276"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:12.622612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] validate_networks() for [('3e685649-08ee-406b-ab8b-0039878e0276', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:14:12.700250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:14:12.701437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:14:12.701988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:14:12.702605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:14:12.703670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:14:12.762783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:12.764047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:12.765373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:12.768777 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:12.893471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Getting quotas for project 68d0088601ff4df8abe8e557d5ce5c91. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:12.907414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Getting quotas for user e13f739a10a34d73886a80ec581d5c9e and project 68d0088601ff4df8abe8e557d5ce5c91. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:12.952374 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:14:12.958326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:14:13.243831 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-702c7c04-5a7c-4fa0-8cd6-66ebe978e77b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.217479 Nov 21 17:14:13.245837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 13/25] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:14:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 17:14:13.255011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3adc48c2-3c28-4258-b491-552c20aaa917 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbf516c10>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:13.401079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3adc48c2-3c28-4258-b491-552c20aaa917 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 200 len: 352 microversion: 2.1 time: 0.153709 Nov 21 17:14:13.402050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 14/26] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:13 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:13.407381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2cf81906-8af5-4d55-bbef-5d4145be7f05 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf516ca0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:13.475847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2cf81906-8af5-4d55-bbef-5d4145be7f05 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 287 microversion: 2.1 time: 0.072542 Nov 21 17:14:13.477253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 15/27] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:13 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:13.483771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2ddf0482-c59c-4147-8753-e4c11416e722 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:13.486856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2ddf0482-c59c-4147-8753-e4c11416e722 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:13.818189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2ddf0482-c59c-4147-8753-e4c11416e722 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:13.872180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2ddf0482-c59c-4147-8753-e4c11416e722 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1214 microversion: 2.1 time: 0.393367 Nov 21 17:14:13.877387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:13 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:14.417904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e86300bb-29bf-4472-9f41-aaea6f6402e7 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Calling method '.version_select at 0x7f1fbe4c0700>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:14.481096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-e86300bb-29bf-4472-9f41-aaea6f6402e7 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] HTTP exception thrown: Volume 0138c9ae-43e7-45ca-b4cb-71ce092a5849 could not be found. Nov 21 17:14:14.484548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e86300bb-29bf-4472-9f41-aaea6f6402e7 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] Returning 404 to user: Volume 0138c9ae-43e7-45ca-b4cb-71ce092a5849 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:14.490277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e86300bb-29bf-4472-9f41-aaea6f6402e7 tempest-VolumesGetTestJSON-1491296119 tempest-VolumesGetTestJSON-1491296119-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849" status: 404 len: 109 microversion: 2.1 time: 0.075838 Nov 21 17:14:14.492368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 17/29] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:14 2021] GET /compute/v2.1/os-volumes/0138c9ae-43e7-45ca-b4cb-71ce092a5849 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:14.506809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b7916dbd-64c6-423d-b5d2-b181a5b33d1b tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4cf4c0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:14.581325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b7916dbd-64c6-423d-b5d2-b181a5b33d1b tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 288 microversion: 2.1 time: 0.086714 Nov 21 17:14:14.584063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 18/30] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:14 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:14.605516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a815abd6-a232-4246-96cb-00f48a0af74b tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4cfd30>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:14.871622 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a815abd6-a232-4246-96cb-00f48a0af74b tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 202 len: 0 microversion: 2.1 time: 0.276207 Nov 21 17:14:14.873955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1253 bytes} [Sun Nov 21 17:14:14 2021] DELETE /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:14:14.899921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1f9cf0f8-8f01-4346-9b4f-535a6207b3d6 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4da430>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:15.002751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1f9cf0f8-8f01-4346-9b4f-535a6207b3d6 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 200 len: 287 microversion: 2.1 time: 0.121680 Nov 21 17:14:15.005271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 20/32] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:14 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:14:15.044001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ae4486b2-d09f-4cf5-b94d-c23fe890ed65 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:15.061481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ae4486b2-d09f-4cf5-b94d-c23fe890ed65 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:15.744741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ae4486b2-d09f-4cf5-b94d-c23fe890ed65 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:15.796151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ae4486b2-d09f-4cf5-b94d-c23fe890ed65 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1214 microversion: 2.1 time: 0.784439 Nov 21 17:14:15.805237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 21/33] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:15 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1214 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:15.839219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fa28e7c2-0698-4b16-a3e7-7b8ed5d70b6c tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe4daaf0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:16.150546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fa28e7c2-0698-4b16-a3e7-7b8ed5d70b6c tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e6301164-de14-4b4b-b375-211d3ba2b918" status: 200 len: 351 microversion: 2.1 time: 0.338030 Nov 21 17:14:16.152231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 22/34] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:15 2021] GET /compute/v2.1/os-volumes/e6301164-de14-4b4b-b375-211d3ba2b918 => generated 351 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:16.161429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1aea9c24-b927-453b-8724-cbad9672614c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4da5e0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:16.249575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-1aea9c24-b927-453b-8724-cbad9672614c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] HTTP exception thrown: Snapshot 6b6fb097-db9a-4710-a0f2-ca08af812cf4 could not be found. Nov 21 17:14:16.250939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1aea9c24-b927-453b-8724-cbad9672614c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Returning 404 to user: Snapshot 6b6fb097-db9a-4710-a0f2-ca08af812cf4 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:16.252119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1aea9c24-b927-453b-8724-cbad9672614c tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4" status: 404 len: 111 microversion: 2.1 time: 0.098520 Nov 21 17:14:16.257751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 23/35] 10.222.0.52 () {58 vars in 1250 bytes} [Sun Nov 21 17:14:16 2021] GET /compute/v2.1/os-snapshots/6b6fb097-db9a-4710-a0f2-ca08af812cf4 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:16.262247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ebba283f-6b09-4d0e-a305-14ea28a93c46 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe4da310>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:16.503941 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ebba283f-6b09-4d0e-a305-14ea28a93c46 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.249202 Nov 21 17:14:16.504891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 24/36] 10.222.0.52 () {58 vars in 1133 bytes} [Sun Nov 21 17:14:16 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:16.511560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e70d5fee-4b62-40bc-a7db-f0a878798545 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf52f550>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:16.525389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:14:16.526281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:14:16.527444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:14:16.528168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:14:16.529628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:14:16.582424 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:16.588071 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:16.589742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:16.590479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:16.647733 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e70d5fee-4b62-40bc-a7db-f0a878798545 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 202 len: 0 microversion: 2.1 time: 0.140699 Nov 21 17:14:16.649431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 25/37] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:14:16 2021] DELETE /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:14:16.714551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:16.728033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for user 4c6cd4fc3c724700b710d79faca5e698 and project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:16.796517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:14:16.812117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:14:17.032156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'create', calling method: .version_select at 0x7f1fbe4cfe50>, body: {"keypair": {"name": "tempest-keypair-582424479"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:17.138906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6be1f923-eab6-4ca5-8407-35cc69af2f42 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.092441 Nov 21 17:14:17.139956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 13/38] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:14:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 5094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:14:17.143972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:17.153889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:17.171403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c68fbc69-e281-4ac0-8382-142be200faef tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbf596310>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:17.421712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c68fbc69-e281-4ac0-8382-142be200faef tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.279954 Nov 21 17:14:17.435666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 14/39] 10.222.0.52 () {58 vars in 1148 bytes} [Sun Nov 21 17:14:17 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:17.443250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ec2b5c32-7970-48f0-b4da-da8cb3692cdb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbf61e790>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:17.516735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-ec2b5c32-7970-48f0-b4da-da8cb3692cdb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] HTTP exception thrown: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. Nov 21 17:14:17.517345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ec2b5c32-7970-48f0-b4da-da8cb3692cdb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Returning 404 to user: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:17.518193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ec2b5c32-7970-48f0-b4da-da8cb3692cdb tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 404 len: 109 microversion: 2.1 time: 0.081180 Nov 21 17:14:17.518777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 15/40] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:17 2021] GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:17.538316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:17.543336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:17.548702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:17.570199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:17.588100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:17.590572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:17.595095 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:17.596754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:17.651698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b96e3008-f67f-45fc-ad5c-87ce4df1292c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.999942 Nov 21 17:14:17.678924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 26/41] 10.222.0.52 () {62 vars in 1198 bytes} [Sun Nov 21 17:14:16 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1028 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 21 17:14:17.696400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9e4686b-c653-4787-a408-d76256c1132e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:17.697446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9e4686b-c653-4787-a408-d76256c1132e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:18.222192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9e4686b-c653-4787-a408-d76256c1132e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:18.262511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9e4686b-c653-4787-a408-d76256c1132e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1218 microversion: 2.1 time: 0.580482 Nov 21 17:14:18.265080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 27/42] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:17 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1218 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:18.273477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:18.279891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-17420d35-5805-4035-81a6-9d5edd0a8746 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe49aaf0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:18.298205 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-329ebf2b-0b17-48a0-96d4-5bd61bf550e1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1266 microversion: 2.1 time: 0.767020 Nov 21 17:14:18.298830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 16/43] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:17 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1266 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:18.307861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6f3687e1-7446-44d0-b63b-d2ad45cb0e1d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4335e0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:18.501545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-6f3687e1-7446-44d0-b63b-d2ad45cb0e1d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] HTTP exception thrown: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. Nov 21 17:14:18.510311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6f3687e1-7446-44d0-b63b-d2ad45cb0e1d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Returning 404 to user: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:18.512298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6f3687e1-7446-44d0-b63b-d2ad45cb0e1d tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 404 len: 109 microversion: 2.1 time: 0.212172 Nov 21 17:14:18.513647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 17/44] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:14:18 2021] DELETE /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:18.540782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-47a7cb76-edac-4340-a338-4dbb7e20f741 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Calling method '.version_select at 0x7f1fbe4003a0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:18.706576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-47a7cb76-edac-4340-a338-4dbb7e20f741 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] HTTP exception thrown: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. Nov 21 17:14:18.707831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-47a7cb76-edac-4340-a338-4dbb7e20f741 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] Returning 404 to user: Volume 8690df1e-47cc-4e2f-9d33-00137c0885c6 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:14:18.710151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-47a7cb76-edac-4340-a338-4dbb7e20f741 tempest-VolumesSnapshotsTestJSON-762568353 tempest-VolumesSnapshotsTestJSON-762568353-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6" status: 404 len: 109 microversion: 2.1 time: 0.188431 Nov 21 17:14:18.711171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 18/45] 10.222.0.52 () {58 vars in 1244 bytes} [Sun Nov 21 17:14:18 2021] GET /compute/v2.1/os-volumes/8690df1e-47cc-4e2f-9d33-00137c0885c6 => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:14:18.762737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-17420d35-5805-4035-81a6-9d5edd0a8746 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.495097 Nov 21 17:14:18.773969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 28/46] 10.222.0.52 () {58 vars in 1133 bytes} [Sun Nov 21 17:14:18 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:18.793438 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ba337206-9c07-4592-a799-7b52e1722ebd tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe49bf70>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:19.298573 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-17459308-e39c-4403-b373-2ffa37bbb7c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:19.299787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-17459308-e39c-4403-b373-2ffa37bbb7c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:19.368549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ba337206-9c07-4592-a799-7b52e1722ebd tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.589331 Nov 21 17:14:19.382268 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 19/47] 10.222.0.52 () {58 vars in 1166 bytes} [Sun Nov 21 17:14:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:19.394476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:19.408236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:19.433744 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:19.446864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:19.448646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:19.453890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:19.936673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-17459308-e39c-4403-b373-2ffa37bbb7c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:19.979273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-17459308-e39c-4403-b373-2ffa37bbb7c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1218 microversion: 2.1 time: 0.688258 Nov 21 17:14:19.984418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:19.991274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 29/48] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:19 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1218 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:20.020483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-36920821-2087-4893-bca9-1994d62c3f51 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbf592280>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:20.033795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8439ebcc-4ca5-41c8-ae89-de8c2e6193be tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1272 microversion: 2.1 time: 0.649904 Nov 21 17:14:20.042090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 20/49] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:19 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1272 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:20.434564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-36920821-2087-4893-bca9-1994d62c3f51 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.441208 Nov 21 17:14:20.436329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 30/50] 10.222.0.52 () {58 vars in 1169 bytes} [Sun Nov 21 17:14:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:20.450049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c5db209c-971a-413a-b638-6a4ee43e5548 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe400670>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:20.904892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c5db209c-971a-413a-b638-6a4ee43e5548 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.458157 Nov 21 17:14:20.907206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 21/51] 10.222.0.52 () {58 vars in 1154 bytes} [Sun Nov 21 17:14:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:20.925029 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d1cf09f8-e375-43c4-a2f0-c0a863219ae8 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe49a820>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:21.009622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:21.010989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:21.043250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:21.045801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:21.057510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:21.060740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:21.170232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d1cf09f8-e375-43c4-a2f0-c0a863219ae8 tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.255361 Nov 21 17:14:21.171132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 31/52] 10.222.0.52 () {58 vars in 1187 bytes} [Sun Nov 21 17:14:20 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:21.184095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:21.185997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:21.219466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:21.223806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:21.226363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:21.230523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:23.104900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:23.126801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dff71c19-94eb-4dd2-b422-f13ad3bc03d6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1270 microversion: 2.1 time: 2.122181 Nov 21 17:14:23.133591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 22/53] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:21 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1270 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:23.157892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2d3d01dd-aca2-4603-be14-e2d7149ebd2a tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] Calling method '.version_select at 0x7f1fbe400af0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:23.163066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:23.214787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-98c1e87d-9b2d-4772-8017-7d83ff93687c tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1272 microversion: 2.1 time: 2.042195 Nov 21 17:14:23.215706 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 32/54] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:21 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1272 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:23.741591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2d3d01dd-aca2-4603-be14-e2d7149ebd2a tempest-VolumesTestJSON-342932673 tempest-VolumesTestJSON-342932673-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.606475 Nov 21 17:14:23.742649 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 23/55] 10.222.0.52 () {58 vars in 1154 bytes} [Sun Nov 21 17:14:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:24.162063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:24.167434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:24.225781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:24.226935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:24.235939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:24.236517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:24.237285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:24.238031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:24.260636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:24.261182 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:24.296723 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:24.302188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:24.821770 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:24.836261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9ea35c1-08a5-4a0c-9674-e0aa290956c0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1276 microversion: 2.1 time: 0.681499 Nov 21 17:14:24.856327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 33/56] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:24 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1276 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:25.878284 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:25.883212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:25.889591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:25.942240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-74109617-0bd9-4ea0-a203-99eff0db7655 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.710459 Nov 21 17:14:25.948687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:25.948687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:25.949641 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:25.953657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 24/57] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:24 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:25.974755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:26.681115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:26.698355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bf09d3cf-4f52-491d-ac88-5d588852343f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1276 microversion: 2.1 time: 0.828953 Nov 21 17:14:26.722544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 34/58] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:25 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1276 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:26.990994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:26.993324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:27.027789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:27.029602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:27.036185 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:27.037544 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:27.768508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:27.769477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:27.823953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:27.825679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:27.830074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:27.832908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:28.394852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:28.442681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6592e185-d680-4258-a15c-81d8a967cc4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.461332 Nov 21 17:14:28.470774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 25/59] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:26 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:29.170722 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:29.209719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8f5dc763-c2c8-4149-a4f6-9e8b980e1d67 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 1.459853 Nov 21 17:14:29.225147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 35/60] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:27 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:29.488272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:29.490396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:29.520416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:29.525479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:29.533287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:29.536013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:30.263527 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:30.270314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:30.293212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:30.294791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:30.296538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:30.297973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:31.142194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:31.179068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5dfaa3bd-8d5a-4abd-8cf1-6d21c3ba8a67 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.697955 Nov 21 17:14:31.183399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 26/61] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:29 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:31.441387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:31.455155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cf9e6ca1-570f-41ed-96e5-ee5521fa7f84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 1.203504 Nov 21 17:14:31.462072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 36/62] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:30 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:32.203842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:32.205188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:32.253158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:32.254367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:32.255491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:32.257679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:32.496067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:32.500004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:32.530860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:32.531415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:32.532254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:32.532693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:33.102913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:33.113347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1b6c42aa-c54d-4f2c-8330-b191c12b1443 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.914170 Nov 21 17:14:33.115320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 27/63] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:32 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:33.123766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1742117374", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc231359-b800-4314-9a90-40584942a625"}], "security_groups": [{"name": "tempest-securitygroup--1750177742"}], "key_name": "tempest-keypair-582424479", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:33.250989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:33.300108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-edfcca02-e582-4097-82ac-9fcd0e0da787 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.808080 Nov 21 17:14:33.301479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 37/64] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:32 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:33.997906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] validate_networks() for [('fc231359-b800-4314-9a90-40584942a625', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:14:34.076424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-8a6d9a93-981e-4f31-bc6b-930577a11c84 req-dc0c7b1e-899f-4410-a8f4-c914490fbb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5990ef-a98a-419b-977b-ef39818b71cf", "tag": "edbf4348-bbb1-49ed-9340-fd401017d0c4"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:34.098576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:34.098576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:14:34.158126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-8a6d9a93-981e-4f31-bc6b-930577a11c84 req-dc0c7b1e-899f-4410-a8f4-c914490fbb8c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:34.159271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-8a6d9a93-981e-4f31-bc6b-930577a11c84 req-dc0c7b1e-899f-4410-a8f4-c914490fbb8c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:34.214190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-8a6d9a93-981e-4f31-bc6b-930577a11c84 req-dc0c7b1e-899f-4410-a8f4-c914490fbb8c service nova] Creating event network-changed:edbf4348-bbb1-49ed-9340-fd401017d0c4 for instance 5c5990ef-a98a-419b-977b-ef39818b71cf on hv-cinder-81869 Nov 21 17:14:34.215933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-8a6d9a93-981e-4f31-bc6b-930577a11c84 req-dc0c7b1e-899f-4410-a8f4-c914490fbb8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=115854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 21 17:14:34.218796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:34.239715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:34.247641 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:34.249013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:34.271994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.compute.rpcapi [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 21 17:14:34.273946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] Releasing lock "compute-rpcapi-router" {{(pid=115854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 21 17:14:34.357193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-728c2adc-f073-4c32-aa35-52b36642b538 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.048021 Nov 21 17:14:34.359153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 38/65] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:35.006672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1533667546", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38958516-ed5b-418c-8ca9-846681a18bcd"}]}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:35.229498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] validate_networks() for [('38958516-ed5b-418c-8ca9-846681a18bcd', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:14:37.110363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:14:37.113140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:14:37.114423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:14:37.114423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:14:37.114680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:14:37.148343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.148804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.149663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.150106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.192904 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:37.206097 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:37.245865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:14:37.249531 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:14:37.394565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1f8ece81-4f42-4b15-89e2-fe3f0666cbb6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.277590 Nov 21 17:14:37.395374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 28/66] 10.222.0.52 () {62 vars in 1187 bytes} [Sun Nov 21 17:14:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 4279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 21 17:14:37.401021 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:37.402303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:37.411590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.412458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.413542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.414310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.558267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:14:37.558874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:14:37.559388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:14:37.559811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:14:37.560230 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:14:37.580147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.581794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.583454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.588063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.654835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Getting quotas for project d1ef489be46143b6a5b731519ccf5ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:37.670487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Getting quotas for user d10a3b3e097c4e809f2ccad5d315284f and project d1ef489be46143b6a5b731519ccf5ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:37.693628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:37.705084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e7c8a4fd-6391-4c0b-9df1-000fb88e8bfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.308122 Nov 21 17:14:37.705676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 29/67] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:37 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:37.725854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:14:37.729129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:14:37.745464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:37.749160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:37.763362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.764533 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.769069 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:37.769877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:37.853442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-060176bf-b0a8-4d1d-987a-2743909dbf0e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.487868 Nov 21 17:14:37.854109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 39/68] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:14:34 2021] POST /compute/v2.1/servers => generated 383 bytes in 3494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:14:38.127401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:38.142333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b6b4e1ae-4a07-4f36-bbba-99f96b052cef tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.404008 Nov 21 17:14:38.146442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 30/69] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:37 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:38.157970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:38.158781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:38.260729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:38.283420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:38.290548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:38.292559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6296944e-c630-4d21-8987-e11fb2330c58 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1281 microversion: 2.20 time: 0.143403 Nov 21 17:14:38.296689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 31/70] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:38 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:38.311530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b4f0209e-ccb2-4ee5-8f7d-f3652962b1fb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:38.318103 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b4f0209e-ccb2-4ee5-8f7d-f3652962b1fb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:38.431497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b4f0209e-ccb2-4ee5-8f7d-f3652962b1fb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:38.441551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b4f0209e-ccb2-4ee5-8f7d-f3652962b1fb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1222 microversion: 2.1 time: 0.143404 Nov 21 17:14:38.447309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 32/71] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:38 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:38.686812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-63b6179c-113b-4233-9357-d5e8c1a179c4 req-6938f418-c98e-4ce7-94d1-c5e2f949ba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c4fbff-6877-43aa-ba5b-636ee99304f9", "tag": "f977a3a4-4548-43ab-9bfd-8999238cf78a"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:38.688528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:38.688528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:14:38.697273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-63b6179c-113b-4233-9357-d5e8c1a179c4 req-6938f418-c98e-4ce7-94d1-c5e2f949ba93 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:38.697921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-63b6179c-113b-4233-9357-d5e8c1a179c4 req-6938f418-c98e-4ce7-94d1-c5e2f949ba93 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:38.722482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:38.723158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:38.737607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:38.737947 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:38.740506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-63b6179c-113b-4233-9357-d5e8c1a179c4 req-6938f418-c98e-4ce7-94d1-c5e2f949ba93 service nova] Creating event network-changed:f977a3a4-4548-43ab-9bfd-8999238cf78a for instance e3c4fbff-6877-43aa-ba5b-636ee99304f9 on hv-cinder-81869 Nov 21 17:14:38.745035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:38.745487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:38.751261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-63b6179c-113b-4233-9357-d5e8c1a179c4 req-6938f418-c98e-4ce7-94d1-c5e2f949ba93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.892801 Nov 21 17:14:38.754411 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 40/72] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:38.826780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1523286344", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38958516-ed5b-418c-8ca9-846681a18bcd"}]}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:38.987149 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] validate_networks() for [('38958516-ed5b-418c-8ca9-846681a18bcd', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:14:39.114003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:39.129446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a8623731-948a-414d-b431-243f48e64145 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.410526 Nov 21 17:14:39.142011 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 33/73] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:38 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:39.176775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:39.180478 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:39.201919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:39.215227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:39.224694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:39.225677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:40.491583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:40.507090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-35c919c0-eb4b-4c4c-85d1-3267d3c0d998 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 1.340424 Nov 21 17:14:40.510824 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 34/74] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:39 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:40.528717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:40.530546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:40.548548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:40.553171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:40.554383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:40.556355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:40.834082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:40.851628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:40.862417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:40.863902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-293aca0a-0932-4291-9cd4-545530a62095 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1339 microversion: 2.20 time: 0.351684 Nov 21 17:14:40.866022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 35/75] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:40 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:40.888633 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:40.889701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:40.920758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:40.925357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:40.928826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:40.933235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:41.307860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:14:41.311348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:14:41.313060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:14:41.313771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:14:41.314648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:14:41.339660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:41.340444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:41.344187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:41.345043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:41.376677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Getting quotas for project d1ef489be46143b6a5b731519ccf5ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:14:41.383059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Getting quotas for user d10a3b3e097c4e809f2ccad5d315284f and project d1ef489be46143b6a5b731519ccf5ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:14:41.412984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:14:41.417615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:14:41.535686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-003ebc08-1f1a-4adb-a528-ba039079e73b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.708692 Nov 21 17:14:41.538312 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 41/76] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:14:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:14:41.570819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:41.578746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:41.596159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:41.597591 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:41.604281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:41.604872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:42.179227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.195565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ff43428f-960c-48c7-b895-d83fade67570 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.326780 Nov 21 17:14:42.196193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 36/77] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:40 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:42.208455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b60758de-531b-4780-8dd4-0b1dd81a94bb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:42.209585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b60758de-531b-4780-8dd4-0b1dd81a94bb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:42.484745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.508279 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6eb1e889-8546-4f07-9cb9-0f1d0d889424 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.967752 Nov 21 17:14:42.515412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 42/78] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:41 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:42.540743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:42.543747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:42.561178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:42.577351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:42.578753 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:42.579292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:42.598673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b60758de-531b-4780-8dd4-0b1dd81a94bb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.610355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b60758de-531b-4780-8dd4-0b1dd81a94bb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1222 microversion: 2.1 time: 0.410601 Nov 21 17:14:42.611005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 37/79] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:42 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:42.797043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.814583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.820785 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:42.822748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e6dae7e3-bad7-40c7-a34d-1bde358f2fc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1339 microversion: 2.20 time: 0.303740 Nov 21 17:14:42.824611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 43/80] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:42 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:43.227314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:43.228963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:43.239936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.247262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.249700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.252158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.535221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:43.536782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:43.544412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.545335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.546445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.547852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.642040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:43.651762 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1c768c84-fc70-4134-9887-5d41e7818c4f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.429161 Nov 21 17:14:43.662601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 38/81] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:43 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:43.667916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:43.669595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:43.677125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.677990 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.679130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.679842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.829864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:43.844729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aac700a2-ad7a-4ba6-b5b8-8dcfd3e35d43 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1274 microversion: 2.1 time: 0.179331 Nov 21 17:14:43.847550 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 39/82] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:43 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:43.858121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:43.860560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:43.870105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.870941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:43.872530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:43.873234 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:44.000714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:44.013049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-723718a4-07f6-42bf-b3f7-96f5c1d66fb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.482589 Nov 21 17:14:44.014277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 44/83] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:43 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:44.034933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-7d09c41c-182f-4a3e-9d70-24025b0e952e req-6e20d191-cf66-4f69-9d11-096ae17a8cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5eddea-80da-4ad2-a69a-4150ee61891a", "tag": "5cddc54e-aef1-4714-acda-c873e87ed0e4"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:44.037858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:44.037858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:14:44.056782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7d09c41c-182f-4a3e-9d70-24025b0e952e req-6e20d191-cf66-4f69-9d11-096ae17a8cfa service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:44.063699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7d09c41c-182f-4a3e-9d70-24025b0e952e req-6e20d191-cf66-4f69-9d11-096ae17a8cfa service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:44.092700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:44.093836 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-7d09c41c-182f-4a3e-9d70-24025b0e952e req-6e20d191-cf66-4f69-9d11-096ae17a8cfa service nova] Creating event network-changed:5cddc54e-aef1-4714-acda-c873e87ed0e4 for instance 7a5eddea-80da-4ad2-a69a-4150ee61891a on hv-cinder-81869 Nov 21 17:14:44.105486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-7d09c41c-182f-4a3e-9d70-24025b0e952e req-6e20d191-cf66-4f69-9d11-096ae17a8cfa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075141 Nov 21 17:14:44.106526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:44.108697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 45/84] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:44.109223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:44.112047 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8e6c5838-bd55-4c89-9710-cc3617e357c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.261580 Nov 21 17:14:44.113380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 40/85] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:43 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:44.672858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:44.673516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:44.680280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:44.681441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:44.682487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:44.683360 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:44.901325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:44.914506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d527aa88-5115-4a25-838b-1016b7b83ff0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.247765 Nov 21 17:14:44.917449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 46/86] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:44 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:44.923078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:44.924107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:44.931851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:44.932322 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:44.933080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:44.933515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.017696 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:45.034686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-64f18c17-0edd-4445-ac3f-5e316ad09da9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1274 microversion: 2.1 time: 0.115515 Nov 21 17:14:45.037199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 47/87] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:44 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:45.056003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-66bcc1d6-fbe1-43bb-ae6c-6eaf417aae00 req-d5c2148e-1456-46f3-8e05-e77cde37c6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c4fbff-6877-43aa-ba5b-636ee99304f9", "name": "network-vif-plugged", "status": "completed", "tag": "f977a3a4-4548-43ab-9bfd-8999238cf78a"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:45.060838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:45.060838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:14:45.063702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:45.064504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:45.083503 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-66bcc1d6-fbe1-43bb-ae6c-6eaf417aae00 req-d5c2148e-1456-46f3-8e05-e77cde37c6fe service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.084317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-66bcc1d6-fbe1-43bb-ae6c-6eaf417aae00 req-d5c2148e-1456-46f3-8e05-e77cde37c6fe service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.096224 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.096224 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.097063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.097518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.152474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-66bcc1d6-fbe1-43bb-ae6c-6eaf417aae00 req-d5c2148e-1456-46f3-8e05-e77cde37c6fe service nova] Creating event network-vif-plugged:f977a3a4-4548-43ab-9bfd-8999238cf78a for instance e3c4fbff-6877-43aa-ba5b-636ee99304f9 on hv-cinder-81869 Nov 21 17:14:45.153390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-66bcc1d6-fbe1-43bb-ae6c-6eaf417aae00 req-d5c2148e-1456-46f3-8e05-e77cde37c6fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=115853) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 21 17:14:45.162476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.165701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.173734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.175123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.217429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.compute.rpcapi [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 21 17:14:45.219633 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] Releasing lock "compute-rpcapi-router" {{(pid=115853) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 21 17:14:45.270749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-befd8900-c0eb-4e1a-b241-360a639fe7ce None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.438657 Nov 21 17:14:45.272035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 41/88] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:14:45.281888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:45.282768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:45.295219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.295814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.298224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.298777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.416059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:45.424570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8799168f-3c5e-4f89-8366-39ca0417f110 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.385966 Nov 21 17:14:45.425150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 48/89] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:45 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:45.505710 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:45.517742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:45.521031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:45.522763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-48c5e568-e297-45eb-9e8e-b77825e7475d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.245844 Nov 21 17:14:45.523588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 42/90] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:45 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:45.942829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:45.948058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:45.963442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.965092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:45.969644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:45.969890 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:46.054778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:46.055657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:46.069395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:46.070657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:46.071847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:46.072446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:46.518001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:46.530968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ea7390ff-b0e1-4134-a2ba-ed395216ef02 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1274 microversion: 2.1 time: 0.477398 Nov 21 17:14:46.533384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 43/91] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:46 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1274 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:46.549786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:46.551414 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:46.571646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:46.574747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:46.576298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:46.577220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:47.228587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:47.243418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e45f5c0e-114a-4f26-a4a0-d12032207475 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.312351 Nov 21 17:14:47.255897 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 49/92] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:45 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:47.271189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:47.273743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:47.299204 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:47.299862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:47.300775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:47.301309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:47.749464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:47.764925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d36d05a4-e284-40de-8318-d0429655dee9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 1.228554 Nov 21 17:14:47.764925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 44/93] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:46 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:47.783860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-8b7d4aa5-2105-4380-b4ff-05d92d714359 req-d65beaa5-3841-4f00-8bc2-80669daa27ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5990ef-a98a-419b-977b-ef39818b71cf", "name": "network-vif-plugged", "status": "completed", "tag": "edbf4348-bbb1-49ed-9340-fd401017d0c4"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:47.791545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:47.791545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:14:47.813149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-8b7d4aa5-2105-4380-b4ff-05d92d714359 req-d65beaa5-3841-4f00-8bc2-80669daa27ab service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:47.815592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-8b7d4aa5-2105-4380-b4ff-05d92d714359 req-d65beaa5-3841-4f00-8bc2-80669daa27ab service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:47.848532 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-8b7d4aa5-2105-4380-b4ff-05d92d714359 req-d65beaa5-3841-4f00-8bc2-80669daa27ab service nova] Creating event network-vif-plugged:edbf4348-bbb1-49ed-9340-fd401017d0c4 for instance 5c5990ef-a98a-419b-977b-ef39818b71cf on hv-cinder-81869 Nov 21 17:14:47.867454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-8b7d4aa5-2105-4380-b4ff-05d92d714359 req-d65beaa5-3841-4f00-8bc2-80669daa27ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100505 Nov 21 17:14:47.879098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 45/94] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:47.891740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:47.893902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:47.913462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:47.914336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:47.921155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:47.922036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:48.386865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:48.418673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-578d7530-3125-4be0-822f-0a54b5968695 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1280 microversion: 2.1 time: 0.536362 Nov 21 17:14:48.435403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 46/95] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:47 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1280 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:48.464855 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:48.477183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:48.498198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:48.506376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:48.508173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:48.509216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:48.829065 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:48.854094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:48.866883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:48.866883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9897f99d-3a70-415c-873c-e08fef263393 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 1.605548 Nov 21 17:14:48.879169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 50/96] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:47 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:48.889444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:48.890465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:48.900524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:48.901735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:48.903950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:48.904973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:49.417668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:49.444368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b579c9b6-5acd-4f5f-ac31-c04e89366815 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 1.006511 Nov 21 17:14:49.461777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 47/97] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:48 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:49.474489 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:49.476020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:49.493446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:49.495143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:49.498548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:49.499757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:49.742665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:49.760368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7940ada6-5427-4e10-8aed-8719134ebdea tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1280 microversion: 2.1 time: 0.300414 Nov 21 17:14:49.779668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 48/98] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:49 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:49.797546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-65e3a8b7-4d1f-4d6d-8fd3-93c5579fd514 req-fbe2ddfd-35f7-4012-b3f5-ea595db7e43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:49.802423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:49.802423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:14:49.814711 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:49.822221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-65e3a8b7-4d1f-4d6d-8fd3-93c5579fd514 req-fbe2ddfd-35f7-4012-b3f5-ea595db7e43c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:49.823757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-65e3a8b7-4d1f-4d6d-8fd3-93c5579fd514 req-fbe2ddfd-35f7-4012-b3f5-ea595db7e43c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:49.848673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-65e3a8b7-4d1f-4d6d-8fd3-93c5579fd514 req-fbe2ddfd-35f7-4012-b3f5-ea595db7e43c service nova] Creating event network-changed:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:14:49.858286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-65e3a8b7-4d1f-4d6d-8fd3-93c5579fd514 req-fbe2ddfd-35f7-4012-b3f5-ea595db7e43c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076088 Nov 21 17:14:49.858591 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3e13dcaa-8159-4a77-9f14-eb77bfcd2f93 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.973036 Nov 21 17:14:49.859643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:48 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:49.860683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 49/100] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:49.899550 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:49.901228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:49.913592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:49.914401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:49.915926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:49.916637 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.211774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:50.227190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:50.230493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:50.232802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a1546633-beef-4270-a471-beb27abf9397 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.341017 Nov 21 17:14:50.233835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 52/101] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:49 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:50.476271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:50.477593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:50.486777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.487284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.488148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.488645 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.648902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:50.660489 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-05640f15-ece2-4626-a03a-2857b72cd936 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.192220 Nov 21 17:14:50.661381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 50/102] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:50 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:50.805848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:50.806850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:50.826957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.826957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.826957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.826957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.882081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:50.883823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:50.895643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.896688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:50.898380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:50.899197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:51.022078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:51.034934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a666351f-2883-4384-a0de-4880b5e39b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.235675 Nov 21 17:14:51.036075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 53/103] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:50 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:51.098219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:51.112341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4fbd056a-1de4-4bde-a0cb-d3fe7a057090 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.236808 Nov 21 17:14:51.113398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 51/104] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:50 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:51.264278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:51.264885 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:51.271472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:51.271918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:51.272707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:51.273136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:51.651334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:51.670151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:51.672995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:51.675740 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-698b3cf4-8804-4c78-a2fe-17f39867875a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.415650 Nov 21 17:14:51.676982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 54/105] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:51 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:14:51.691460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:51.694523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:51.709708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:51.710774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:51.712358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:51.713055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.058243 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:52.060731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:52.072435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.073632 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.075773 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.076612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.087680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:52.100793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-997840b7-c565-4429-8d63-1e5fbf2e1ef8 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.416682 Nov 21 17:14:52.102239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 52/106] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:51 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:52.135566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:52.136529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:52.146463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.147502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.149084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.149996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.544649 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:52.563068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3ebcc93f-561a-4542-adff-14c0be34012b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.511504 Nov 21 17:14:52.564779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 55/107] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:52 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:52.571565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:52.582149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4afef570-0cf8-4c0a-8655-91bc111ec08e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.451333 Nov 21 17:14:52.583134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 53/108] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:52 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:52.701087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:52.702725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:52.723111 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.724186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.726185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.727478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.870843 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-454f3085-4337-449e-b538-67855bab3355 req-a89cd700-320d-42ea-b0c1-d3f305e3a619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9bda498-a1ce-48c5-81a0-2aeb932f2ad3", "tag": "488447a4-db33-45b2-a3c1-19d43272bd72"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:14:52.875905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:14:52.875905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:14:52.901573 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-454f3085-4337-449e-b538-67855bab3355 req-a89cd700-320d-42ea-b0c1-d3f305e3a619 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:52.903462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-454f3085-4337-449e-b538-67855bab3355 req-a89cd700-320d-42ea-b0c1-d3f305e3a619 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:52.937979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-454f3085-4337-449e-b538-67855bab3355 req-a89cd700-320d-42ea-b0c1-d3f305e3a619 service nova] Creating event network-changed:488447a4-db33-45b2-a3c1-19d43272bd72 for instance b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 on hv-cinder-81869 Nov 21 17:14:52.948066 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-454f3085-4337-449e-b538-67855bab3355 req-a89cd700-320d-42ea-b0c1-d3f305e3a619 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082643 Nov 21 17:14:52.951527 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 54/109] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:14:53.011452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.024771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.026650 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.028775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-68f4e268-2990-467e-b8c3-d28efd58af34 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.334024 Nov 21 17:14:53.029330 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 56/110] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:52 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:53.131809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:53.133383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:53.145858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.146677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.148244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.149031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.397850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.411887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-56e60c5a-4d9d-4283-a16d-d7edf07ce77a tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.287212 Nov 21 17:14:53.412778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 55/111] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:53 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:53.592447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:53.593169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:53.600088 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.600541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.601341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.601788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.618000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:53.618977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:53.629787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.630504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.631554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:53.632359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:53.817338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.826893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5aecbfe7-1207-422a-b428-4b47f9689329 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.238601 Nov 21 17:14:53.827847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 57/112] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:53 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:53.886348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:53.894142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d5fadd3c-0337-4c59-a431-093372b2acbb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.282395 Nov 21 17:14:53.895337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 56/113] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:53 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:54.051976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:54.058189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:54.068010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.068962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.070960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.071592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.315605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:54.334240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:54.338599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:54.340319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c1ba24a1-d021-42c0-af58-c34dd8b54611 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.295524 Nov 21 17:14:54.341424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 58/114] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:54 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:54.440091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:54.440836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:54.447307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.447783 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.448575 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.449094 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.631297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:54.650682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1cff9665-10cc-40b4-ba33-bb097fd77b33 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.214170 Nov 21 17:14:54.651731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 57/115] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:54 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:54.852814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:54.853734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:54.861373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.862054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.863260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.863901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.921107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:54.922286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:54.929300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.930515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:54.931558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:54.932158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:55.111981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:55.126354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2b5bea50-e77a-4c42-8361-2b8e13acdbdb tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.277687 Nov 21 17:14:55.127444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 59/116] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:54 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:55.195834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:55.211480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-45628fee-386a-47d5-a57c-0b1dbbab5583 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.294304 Nov 21 17:14:55.212300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 58/117] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:54 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:55.375138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:55.376549 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:55.388595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:55.390256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:55.392058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:55.393477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:55.677170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:55.677718 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:55.684736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:55.691201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:55.696118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:55.696921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:56.052492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.077225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.080929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.085071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-60826dc2-c79b-4533-a349-18c3d999f516 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.718412 Nov 21 17:14:56.085731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 60/118] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:55 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:56.107454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.115668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9132128d-fe0a-4749-85ed-fdd88fc47ead tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.449352 Nov 21 17:14:56.116251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 59/119] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:55 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:56.144309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:56.145155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:56.153300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:56.153751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:56.154528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:56.155253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:56.248500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:56.249667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:56.256800 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:56.257404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:56.258351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:56.258946 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:56.373146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.389916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c68d6879-f555-43af-bbc2-56af991bc64e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.248855 Nov 21 17:14:56.400588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 61/120] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:56 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:56.467965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:56.476176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d08f7b2a-7675-4726-9b9f-86c3105e64c9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.232755 Nov 21 17:14:56.476755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 60/121] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:56 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:57.109041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:57.110231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:57.121001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.121855 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.123321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.124105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.136178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:57.137369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:57.145596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.146259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.147246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.147842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.405076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.416304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.417576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-34505748-e97a-4d36-9381-103a2023785b tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.286546 Nov 21 17:14:57.419203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 61/122] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:57 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:57.432463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.435841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:57.436327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.436444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:57.438549 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a95bdcd6-ece0-4ae6-acab-123db6019a4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.337177 Nov 21 17:14:57.439661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 62/123] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:57 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:14:57.444156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.444691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.445941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.446442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.503368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:57.504429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:57.516806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.517617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.519123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:57.519939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:57.687975 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.704456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-69accdc9-db2a-4b75-b587-8372a7b9fd62 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.272125 Nov 21 17:14:57.706339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 62/124] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:57 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:57.778183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:57.788235 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bb6218ce-947c-4e88-8e96-76a7509d2f43 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.289252 Nov 21 17:14:57.789053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 63/125] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:57 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:58.437207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:58.437841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:58.444204 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.444646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.445434 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.445872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.468436 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:58.469540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:58.476346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.476924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.477818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.478346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.659314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:58.674711 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9886dc1d-077a-455e-81c2-90563bfbed6f tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1314 microversion: 2.1 time: 0.240950 Nov 21 17:14:58.675753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 63/126] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:58 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:58.697826 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:58.712551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:58.716666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:58.718734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0bc57f74-cc2d-431f-a0c3-26969f75c4ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.254835 Nov 21 17:14:58.720007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 64/127] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:58 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:14:58.737200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:58.738449 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:58.746352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.746878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.747935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.748439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.811331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:58.812032 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:58.821129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.821591 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:58.823575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:58.824023 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:59.284807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:59.295721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e85a83ed-98f6-497b-a0c3-2d892f5927c3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.566776 Nov 21 17:14:59.303989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 64/128] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:58 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:14:59.350405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:14:59.370495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0f89bc29-27f5-46ee-94dd-1e0776a290fb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1318 microversion: 2.1 time: 0.563332 Nov 21 17:14:59.371571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 65/129] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:58 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:14:59.693140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:59.693754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:59.700286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:59.700878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:59.701846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:59.702374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:59.744449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:14:59.745328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:14:59.753164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:59.754012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:14:59.767679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:14:59.768141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:00.096702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.102379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.107736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.109902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.112328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-541c93cd-f7cf-4025-aa3d-283d79105f7c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.371719 Nov 21 17:15:00.113915 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 66/130] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:14:59 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:00.120829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ef73ef34-a862-450c-bf82-84fe93e98770 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1501 microversion: 2.1 time: 0.431151 Nov 21 17:15:00.122063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 65/131] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:14:59 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:00.333465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:00.334844 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:00.345346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:00.346721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:00.347955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:00.348817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:00.391854 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:00.392365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:00.400844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:00.401597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:00.403315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:00.404067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:00.741425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.748849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:00.758463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4bf856d1-5327-4f50-8d02-a83a11988095 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1508 microversion: 2.1 time: 0.371935 Nov 21 17:15:00.759386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-72dd911f-a603-44d1-9542-7d6305ee375c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.432297 Nov 21 17:15:00.760590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 66/132] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:00 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:00.760950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 67/133] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:00 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:01.135159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:01.136781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:01.144519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.145054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:01.145968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.146570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:01.332803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:01.343045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:01.344627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:01.346070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2c479310-b884-43da-b87a-b6807f0005e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.217261 Nov 21 17:15:01.355341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 67/134] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:01 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:01.751462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa0c292-f7eb-4cd7-b253-a6c66991dce6"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:01.752516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:01.758922 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.759366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:01.760146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.760694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:01.785213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:01.786238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:01.796061 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.796764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:01.798041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:01.798804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:02.005773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:02.020048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-068fe140-49d2-4bdb-a9b6-e52d4f6aa16f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.238275 Nov 21 17:15:02.031216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 68/135] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:01 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:02.366356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:02.367115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:02.373569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:02.374012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:02.374821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:02.375262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:02.544603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:02.553480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:02.555020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:02.556228 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c7a81732-2298-4e18-b774-318f2a186efe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.193701 Nov 21 17:15:02.556797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 69/136] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:02 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:15:03.044262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:03.045100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:03.053447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:03.054464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:03.055788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:03.056827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:03.280413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:03.288698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c9a59511-0aab-450f-add7-1859e31e043f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.248340 Nov 21 17:15:03.289331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 70/137] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:03 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:03.576689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:03.577401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:03.584628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:03.585176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:03.586047 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:03.586548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:03.771072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:03.779609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:03.781109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:03.782243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-65a30b7a-2781-4af8-92c2-2da37b207dee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.210599 Nov 21 17:15:03.782843 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 71/138] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:03 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:15:04.310258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:04.311540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:04.320485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:04.321283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:04.322359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:04.323208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:04.366505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b7d4b0ad-4761-4cbb-b4dd-1e03559280d4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "POST /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.618667 Nov 21 17:15:04.367437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 68/139] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:15:01 2021] POST /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf/os-volume_attachments => generated 194 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:04.516676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:04.524787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-08173787-85a0-4457-84df-6a573659d545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.220380 Nov 21 17:15:04.525389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 72/140] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:04 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:04.601697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-dccbfe46-6e8a-4115-983e-4efd1337faa2 req-a7485dea-2a85-48a0-ba10-7160fc925b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5eddea-80da-4ad2-a69a-4150ee61891a", "name": "network-vif-plugged", "status": "completed", "tag": "5cddc54e-aef1-4714-acda-c873e87ed0e4"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:04.603657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:04.603657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:15:04.616122 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-dccbfe46-6e8a-4115-983e-4efd1337faa2 req-a7485dea-2a85-48a0-ba10-7160fc925b51 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:04.617004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-dccbfe46-6e8a-4115-983e-4efd1337faa2 req-a7485dea-2a85-48a0-ba10-7160fc925b51 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:04.632662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-dccbfe46-6e8a-4115-983e-4efd1337faa2 req-a7485dea-2a85-48a0-ba10-7160fc925b51 service nova] Creating event network-vif-plugged:5cddc54e-aef1-4714-acda-c873e87ed0e4 for instance 7a5eddea-80da-4ad2-a69a-4150ee61891a on hv-cinder-81869 Nov 21 17:15:04.639771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-dccbfe46-6e8a-4115-983e-4efd1337faa2 req-a7485dea-2a85-48a0-ba10-7160fc925b51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042573 Nov 21 17:15:04.641263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 69/141] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:04.814692 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:04.818809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:04.842560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:04.844726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:04.846403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:04.847810 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:05.069775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:05.086317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:05.089536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:05.092394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c4443f21-6cb7-4f16-ab4a-96d809952fa5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.293966 Nov 21 17:15:05.094154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 73/142] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:04 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:05.549535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:05.550832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:05.573829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:05.574375 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:05.576920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:05.577720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:05.774558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b81014c-24b2-4645-a8a5-5dc2348ad188"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:05.775776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:05.794464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:05.795168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:05.796269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:05.796729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:05.926882 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:05.935588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-93f53846-6508-4878-88ac-3b8e0491c7bc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.395045 Nov 21 17:15:05.941655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 70/143] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:05 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:06.125565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:06.126208 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:06.136709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:06.140898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:06.143462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:06.144523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:06.526091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:06.536878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:06.541962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:06.550723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-18fafdcc-3aa3-4096-9ccc-b4d3e1e835be tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.429494 Nov 21 17:15:06.552907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 71/144] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:06 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:15:06.754941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c540ec40-d3eb-484e-b70b-22da8f2ac41a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980153 Nov 21 17:15:06.757560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 74/145] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:15:05 2021] POST /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:15:06.907200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-bcb406f0-0829-44e1-8192-06e3164a09f8 req-7fdd4335-705b-456a-b670-05c800f940b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bda498-a1ce-48c5-81a0-2aeb932f2ad3", "name": "network-vif-plugged", "status": "completed", "tag": "488447a4-db33-45b2-a3c1-19d43272bd72"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:06.912414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:06.912414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:15:06.941508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-bcb406f0-0829-44e1-8192-06e3164a09f8 req-7fdd4335-705b-456a-b670-05c800f940b5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:06.942278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-bcb406f0-0829-44e1-8192-06e3164a09f8 req-7fdd4335-705b-456a-b670-05c800f940b5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:06.959012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:06.959826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:06.972906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:06.973352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:06.974188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:06.974651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:07.004174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-bcb406f0-0829-44e1-8192-06e3164a09f8 req-7fdd4335-705b-456a-b670-05c800f940b5 service nova] Creating event network-vif-plugged:488447a4-db33-45b2-a3c1-19d43272bd72 for instance b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 on hv-cinder-81869 Nov 21 17:15:07.047571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-bcb406f0-0829-44e1-8192-06e3164a09f8 req-7fdd4335-705b-456a-b670-05c800f940b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147302 Nov 21 17:15:07.053258 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 72/146] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:07.399642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:07.421605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-72297de0-60bb-4982-996f-8d48583e777f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.467706 Nov 21 17:15:07.424987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:06 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:07.587423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:07.596249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:07.613560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:07.614226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:07.615281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:07.616143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:07.927123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:07.951622 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:07.963438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:07.965806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f92462f7-317c-4a79-8046-4306b498a631 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.384250 Nov 21 17:15:07.970219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 73/148] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:07 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:08.448932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:08.451304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:08.462663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:08.463443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:08.464886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:08.467720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:08.683685 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:08.696169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5b42d1c7-97ca-44b4-9fd4-4fd7a740c4df tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.254117 Nov 21 17:15:08.697359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:08 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:09.003323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:09.003323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:09.007421 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:09.008092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:09.008995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:09.009745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:09.114190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-dff59d5c-af28-4e77-9528-9cefb14ac932 req-b126aaef-2830-440f-ac6a-a33730a20678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "name": "network-vif-plugged", "status": "completed", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:09.115912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:09.115912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:09.128978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-dff59d5c-af28-4e77-9528-9cefb14ac932 req-b126aaef-2830-440f-ac6a-a33730a20678 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:09.129411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-dff59d5c-af28-4e77-9528-9cefb14ac932 req-b126aaef-2830-440f-ac6a-a33730a20678 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:09.165055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-dff59d5c-af28-4e77-9528-9cefb14ac932 req-b126aaef-2830-440f-ac6a-a33730a20678 service nova] Creating event network-vif-plugged:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:15:09.189770 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-dff59d5c-af28-4e77-9528-9cefb14ac932 req-b126aaef-2830-440f-ac6a-a33730a20678 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074541 Nov 21 17:15:09.192114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 77/150] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:15:09.217574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:09.227256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:09.228861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:09.230437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3efd5a31-4216-4c18-8ab9-377507b3bc85 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.245645 Nov 21 17:15:09.231054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 74/151] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:08 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:09.722972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:09.724047 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:09.736244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:09.736244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:09.736244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:09.736244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:09.956389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:09.971962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7a65c454-0a68-4455-941b-74c44dbd5b1c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.258060 Nov 21 17:15:09.972974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 78/152] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:09 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:10.278544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:10.284108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:10.311278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:10.312197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:10.313758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:10.315133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:10.739657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:10.749109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:10.750888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:10.752232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-14aa1a67-9046-4d2f-b09b-40aba3a55a7e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.493165 Nov 21 17:15:10.753073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 75/153] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:10 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:11.012957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:11.017156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:11.040564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:11.043575 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:11.046011 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:11.047443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:11.295310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:11.307752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-833ba4c9-2806-44ef-942f-57c7f6055178 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.307341 Nov 21 17:15:11.311093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 79/154] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:10 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:11.779289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:11.780418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:11.792090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:11.793373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:11.795304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:11.796301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:12.064552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:12.084862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:12.090584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:12.093386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f731393c-a9cb-4962-9d49-a9985ccca7fa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1407 microversion: 2.20 time: 0.321816 Nov 21 17:15:12.094823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 76/155] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:11 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:12.334555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:12.335973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:12.347053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:12.351163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:12.357293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:12.359668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:12.829595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:12.842086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a3ae8eab-17e7-45d6-9bd8-cd11a40fb2ab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1322 microversion: 2.1 time: 0.511592 Nov 21 17:15:12.843320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 80/156] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:12 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:13.114994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:13.116592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:13.123518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.124319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:13.125546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.126277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:13.344482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:13.359578 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:13.364453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:13.373552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-48b23fdd-8d0e-4911-b4cd-2b4114317ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1599 microversion: 2.20 time: 0.256032 Nov 21 17:15:13.395791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 77/157] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:15:13 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1599 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:15:13.409043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:13.410192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:13.425819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.426875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:13.429251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.429657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:13.537690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d125bff9-bfa0-4c5d-a27e-8a7403600186 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131959 Nov 21 17:15:13.538931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 81/158] 10.222.0.52 () {60 vars in 1315 bytes} [Sun Nov 21 17:15:13 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:15:13.880150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:13.881937 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:13.900646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.901837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:13.903607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:13.904702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.212123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:14.234592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7c162ee8-689f-4134-9067-8a6816dc8d22 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1515 microversion: 2.1 time: 0.363732 Nov 21 17:15:14.237712 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 78/159] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:13 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:14.265987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:14.268151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:14.277914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.279049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.280653 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.281322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.314131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lazy-loading 'flavor' on Instance uuid b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:15:14.493027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-436c4146-6a57-4d47-89ba-103ee2c4061e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3/action" status: 200 len: 32 microversion: 2.1 time: 0.231955 Nov 21 17:15:14.493027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 82/160] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:15:14 2021] POST /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:15:14.502901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:14.503827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:14.511713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.512444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.513580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.513995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.695414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:14.706236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a14d75ca-3b66-4482-a12b-a513eec9bec1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.208130 Nov 21 17:15:14.706975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 79/161] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:14 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:14.940227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:14.940984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:14.949647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.950228 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.951215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:14.951842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:14.983026 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:15:15.114749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e41794bc-12d4-4fb3-844a-06eac2b2a590 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 204 len: 0 microversion: 2.1 time: 0.178502 Nov 21 17:15:15.116152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 83/162] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:15:14 2021] DELETE /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 17:15:15.128971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:15.130013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:15.141793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.142534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.144409 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.145530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.319571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:15.332616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a35a9d1f-8555-4fe7-b515-d71dab8f3d4e tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1553 microversion: 2.1 time: 0.210322 Nov 21 17:15:15.333413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 80/163] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:15 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:15.608651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:15.610546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-2b7353d0-8852-4e83-8bda-130f30053471 req-ca004af7-d513-4c01-b1f6-4e92bad185d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:15.611628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:15.612334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:15.612334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:15:15.620053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-2b7353d0-8852-4e83-8bda-130f30053471 req-ca004af7-d513-4c01-b1f6-4e92bad185d8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.620496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-2b7353d0-8852-4e83-8bda-130f30053471 req-ca004af7-d513-4c01-b1f6-4e92bad185d8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.622604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.623513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.624672 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.625603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.633342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-2b7353d0-8852-4e83-8bda-130f30053471 req-ca004af7-d513-4c01-b1f6-4e92bad185d8 service nova] Creating event network-changed:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:15:15.638804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-2b7353d0-8852-4e83-8bda-130f30053471 req-ca004af7-d513-4c01-b1f6-4e92bad185d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032170 Nov 21 17:15:15.639412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 81/164] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:15:15.725486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:15.726747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:15.736086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.736676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.737975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:15.738520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:15.929917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:15.941365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-004e0eed-c70e-45c4-bf90-bc70901b6f30 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.220447 Nov 21 17:15:15.942358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 82/165] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:15 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:16.414293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:16.417429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:16.439948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:16.440869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:16.442418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:16.443343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:16.650255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:16.661137 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2401f6e4-cd0c-40fb-9908-47abcee7f4de tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1553 microversion: 2.1 time: 0.255316 Nov 21 17:15:16.662546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 83/166] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:16 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:16.887614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-52f54a3b-7317-4ef6-bae4-abc7cc894ceb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 1.285391 Nov 21 17:15:16.896460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 84/167] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:15 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:16.972397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:16.974437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:17.016368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.018560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:17.020199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.021142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:17.469394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:17.487908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-42e214ec-4091-471d-8be7-44920e147975 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.521646 Nov 21 17:15:17.489584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 84/168] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:16 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:17.689809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:17.694437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:17.711078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.712207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:17.714234 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.715668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:17.909716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:17.912195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:17.939310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.941705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:17.945690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:17.949730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:18.126841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ccd13173-39d1-4042-a185-ac57b276751c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 0.224559 Nov 21 17:15:18.127498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 85/169] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:17 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:18.257587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:18.271037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ff1a6f18-ff75-425f-ab48-dd26d058cbe4 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1553 microversion: 2.1 time: 0.590040 Nov 21 17:15:18.272007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 85/170] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:17 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1553 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:18.517139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:18.517843 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:18.524696 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:18.525147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:18.526037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:18.526363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:18.674148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:18.683819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-26e147dc-3cc5-4347-ae79-cef2632a7b1e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.170624 Nov 21 17:15:18.684523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 86/171] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:18 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:19.141285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:19.142388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:19.149349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.149862 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:19.150771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.151280 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:19.218319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-921c428e-bab2-4161-af09-381908e2cc41 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 0.082499 Nov 21 17:15:19.219137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 86/172] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:19 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:19.289693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:19.290490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:19.297498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.298069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:19.298914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.299355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:19.508560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:19.518801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4d4499aa-b91b-4972-9f5a-9ce2e37473bb tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1553 microversion: 2.1 time: 0.232500 Nov 21 17:15:19.520497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 87/173] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:19 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:19.707426 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:19.709637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:19.722857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.724034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:19.726112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:19.727255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.004705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:20.030161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b9b51a25-9d10-4d65-ae55-9758f0638af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.328598 Nov 21 17:15:20.042906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 87/174] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:19 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:20.233295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:20.234661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:20.242903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:20.244483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.246236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:20.247024 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.355406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b9488369-f48b-445f-9e2d-3405d08eb9d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 0.128105 Nov 21 17:15:20.358188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 88/175] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:20 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:20.529506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-e3bd0e80-b5f2-43b5-9633-5d4ef9c28592 req-06613e6e-3f36-437f-b96c-b3a6a3617d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5990ef-a98a-419b-977b-ef39818b71cf", "name": "network-vif-deleted", "tag": "edbf4348-bbb1-49ed-9340-fd401017d0c4"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:20.531147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:20.531147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:20.538405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-e3bd0e80-b5f2-43b5-9633-5d4ef9c28592 req-06613e6e-3f36-437f-b96c-b3a6a3617d9a service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:20.539491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-e3bd0e80-b5f2-43b5-9633-5d4ef9c28592 req-06613e6e-3f36-437f-b96c-b3a6a3617d9a service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.556497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-e3bd0e80-b5f2-43b5-9633-5d4ef9c28592 req-06613e6e-3f36-437f-b96c-b3a6a3617d9a service nova] Creating event network-vif-deleted:edbf4348-bbb1-49ed-9340-fd401017d0c4 for instance 5c5990ef-a98a-419b-977b-ef39818b71cf on hv-cinder-81869 Nov 21 17:15:20.557829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:20.560455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:20.563897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-e3bd0e80-b5f2-43b5-9633-5d4ef9c28592 req-06613e6e-3f36-437f-b96c-b3a6a3617d9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 Nov 21 17:15:20.569362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 88/176] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:20.601824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:20.607661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.608791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:20.609422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:20.694377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:20.704024 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cedfa721-29d9-495b-b6c6-6de40669a175 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.163139 Nov 21 17:15:20.704839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 89/177] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:20 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:21.062854 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:21.065070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:21.075965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.077036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.078606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.079573 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.264027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:21.272949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b2a035f7-1ea9-4284-baac-932a0bacae08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.218903 Nov 21 17:15:21.273867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 89/178] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:21 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:21.369795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:21.371653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:21.378318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.378723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.379719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.380387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.722604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:21.723671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:21.734041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.734953 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.737015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:21.737829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:21.813758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:21.822123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aea89bdd-1f30-4295-af30-573b098c0cc1 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.103343 Nov 21 17:15:21.822748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 90/179] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:21 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:22.301623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:22.302600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:22.313500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:22.314063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:22.315333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:22.315775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:22.498459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:22.506151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-edaaafbd-9d64-49f8-8fe2-0ab3d1e057e1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.210682 Nov 21 17:15:22.506766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 91/180] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:22 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:22.841982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:22.842595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:22.848813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:22.849257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:22.850033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:22.850463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:22.926224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:22.935399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0f756039-d7bb-4df5-b77c-f9a6596664e0 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.097304 Nov 21 17:15:22.940820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 92/181] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:22 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:23.526399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:23.528991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:23.537016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:23.537466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:23.538253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:23.538718 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:23.669043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:23.676562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f6a9742d-686d-45e5-84ab-3ec29d30deb6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.155766 Nov 21 17:15:23.677145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 93/182] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:23 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:23.710969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e8169c14-0a2d-416b-a5d0-6c85ef70d74c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 2.345576 Nov 21 17:15:23.711964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 90/183] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:21 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:23.955913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:23.957123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:23.965319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:23.965873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:23.966828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:23.967408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:24.052701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:24.061721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-92f55a8b-d353-429f-b962-a4a6a140bb11 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.113275 Nov 21 17:15:24.062477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:23 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:24.694827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:24.695536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:24.703956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:24.704713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:24.705618 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:24.706101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:24.725260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:24.726912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:24.736968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:24.737729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:24.739872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:24.741023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:24.862550 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:24.872188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3ef1c3af-2bfd-4962-b6c9-a86c6dec32d3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.181698 Nov 21 17:15:24.873180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:24 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:25.082948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:25.083991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:25.095698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:25.096518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:25.097955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:25.098874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:25.193116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:25.209931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cba6abff-8184-42d4-bffe-701b4aa44647 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.133836 Nov 21 17:15:25.211106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 92/186] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:25 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:25.898532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:25.899314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:25.907951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:25.908418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:25.910107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:25.916022 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:26.069008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:26.078097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0dbcba76-13f2-47c8-bccd-490cf0e23dab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.183229 Nov 21 17:15:26.078984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 93/187] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:25 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:26.239798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:26.240818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:26.248274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:26.248903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:26.249860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:26.250568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:26.340539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:26.350832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f976f19d-4261-4485-a372-d13257e981ea tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.116096 Nov 21 17:15:26.351461 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 94/188] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:26 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:27.105930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:27.106683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:27.113009 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:27.113524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:27.114255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:27.114774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:27.263849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:27.273335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5d141c11-dd42-4e37-a840-5e48f32276e0 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.172658 Nov 21 17:15:27.273928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 95/189] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:27 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:27.380985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:27.382132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:27.393264 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:27.393993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:27.395404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:27.396188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:27.469324 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:27.477754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bd01a606-0bf8-4706-8685-05538a81a279 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1345 microversion: 2.1 time: 0.104263 Nov 21 17:15:27.478340 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 96/190] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:27 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:27.635134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7e71698b-dc3e-4a47-aa6c-f43793876efd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 2.914028 Nov 21 17:15:27.636098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 95/191] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:24 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:28.293784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:28.294724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:28.308724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.311365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.313077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.314760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.451518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1451430455", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "3e685649-08ee-406b-ab8b-0039878e0276"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:28.573168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] validate_networks() for [('3e685649-08ee-406b-ab8b-0039878e0276', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:15:28.644363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:28.655483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c14386ca-8f53-4d96-b1f5-fc1013a888cd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.366859 Nov 21 17:15:28.656908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 97/192] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:28 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:28.662481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:28.663593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:28.673033 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.673916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.674895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.675578 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.749293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.753388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.757721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lazy-loading 'fault' on Instance uuid 5c5990ef-a98a-419b-977b-ef39818b71cf {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:15:28.909562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f739a10a34d73886a80ec581d5c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0088601ff4df8abe8e557d5ce5c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:28.924890 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1a7a152f-6932-41db-8a8e-030c1ed42dfc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 200 len: 1350 microversion: 2.1 time: 0.265683 Nov 21 17:15:28.925620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 98/193] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:28 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 1350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:28.941287 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:28.944346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:28.961328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.963646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:28.967403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:28.969079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.108648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-20c8f681-4de4-4974-9980-3d4b81165c00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 14 microversion: 2.20 time: 0.180998 Nov 21 17:15:29.109677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 99/194] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:28 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:29.416568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:15:29.419364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:15:29.426849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:15:29.427370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:15:29.427831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:15:29.456477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.457123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.458476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.459185 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.485611 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:15:29.490335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for user 4c6cd4fc3c724700b710d79faca5e698 and project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:15:29.502535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:15:29.505235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:15:29.554512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aeb0b976-3a40-456a-9370-0ed00f76173a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117718 Nov 21 17:15:29.555246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 96/195] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:15:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:15:29.573375 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3e71e839-7951-4705-9794-be7cbd322490 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:29.575361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3e71e839-7951-4705-9794-be7cbd322490 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:29.642112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3e71e839-7951-4705-9794-be7cbd322490 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:29.651818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3e71e839-7951-4705-9794-be7cbd322490 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1218 microversion: 2.1 time: 0.085985 Nov 21 17:15:29.652648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:29 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:29.692081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:29.693278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:29.709850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.710242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.711565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.712095 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.946759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:29.947541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:29.957811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.962559 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.964867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:29.970943 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:29.999383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] HTTP exception thrown: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. Nov 21 17:15:30.000206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Returning 404 to user: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:15:30.001469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ffc8c1d1-c3f9-44ce-b21d-7fb652da7ffc tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 404 len: 111 microversion: 2.1 time: 0.059680 Nov 21 17:15:30.002590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 101/197] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:29 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:15:30.017637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:30.029806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dc2749ee-53d5-4704-a5c8-4b1a73472e5d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.346455 Nov 21 17:15:30.040015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 97/198] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:29 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:30.125030 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:30.125938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:30.143161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.145864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.146782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.147236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.278475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c5147507-d288-4b67-a9f2-f5cc54b50bc6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 2071 microversion: 2.20 time: 0.159507 Nov 21 17:15:30.281293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 102/199] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:30 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 2071 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:15:30.331545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:30.332546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:30.340143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.340594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.342686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.343084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.359717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] HTTP exception thrown: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. Nov 21 17:15:30.360100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Returning 404 to user: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:15:30.361365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-32fdc808-8dfe-40bd-bbf2-5b6fa4448e74 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033868 Nov 21 17:15:30.362271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 98/200] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:15:30 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:15:30.680563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:30.681424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:30.696391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.696999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.698127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:30.699359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:30.834338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:30.870158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-96db9395-6fe2-420c-9225-d5941a134d74 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1270 microversion: 2.1 time: 0.193778 Nov 21 17:15:30.882600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 103/201] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:30 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:31.050089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:31.050981 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:31.062133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.062786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.078428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.079016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.300152 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:31.301580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:31.315579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.316227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.318138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.318812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.382098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:31.396980 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-500356ef-9893-44a3-b9f8-29790f55f842 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.352429 Nov 21 17:15:31.410927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 99/202] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:31 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:31.430205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-69ec3d5e-5b8e-4f97-8a57-147954416719 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 10580 microversion: 2.20 time: 0.135435 Nov 21 17:15:31.431623 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 104/203] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:31 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 10580 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:31.811334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:31.814911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:31.839559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.842017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.844275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.847418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.877019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] HTTP exception thrown: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. Nov 21 17:15:31.877625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Returning 404 to user: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:15:31.878469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6c2576bf-a0a2-40b5-a38e-d1718c8c67db tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 404 len: 111 microversion: 2.1 time: 0.077719 Nov 21 17:15:31.890369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:31.891430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:31.912195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.912195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.912195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.912195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.912465 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 100/204] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:15:31 2021] DELETE /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:15:31.924974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:31.925584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] [instance: 5c5990ef-a98a-419b-977b-ef39818b71cf] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:31.942744 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.947160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.949018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:31.949702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:31.983473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] HTTP exception thrown: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. Nov 21 17:15:31.984717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] Returning 404 to user: Instance 5c5990ef-a98a-419b-977b-ef39818b71cf could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:15:31.985952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-54d32c83-6f4a-473d-83f3-34a829c058a3 tempest-DeleteServersTestJSON-1308592955 tempest-DeleteServersTestJSON-1308592955-project] 10.222.0.52 "GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf" status: 404 len: 111 microversion: 2.1 time: 0.067313 Nov 21 17:15:31.987307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 101/205] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:31 2021] GET /compute/v2.1/servers/5c5990ef-a98a-419b-977b-ef39818b71cf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:15:32.141692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:32.153538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6c47ab6a-4efb-403e-8f01-da86052b920b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1276 microversion: 2.1 time: 0.263321 Nov 21 17:15:32.154873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 105/206] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:31 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:32.424697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:32.425320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:32.433756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:32.434509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:32.435754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:32.436948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:32.447240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:32.449737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:32.464580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:32.472866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:32.474312 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:32.475358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:32.616887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4952785e-e292-4ba8-9d1a-efc0dae77c76 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 15297 microversion: 2.20 time: 0.173979 Nov 21 17:15:32.617652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 106/207] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:32 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 15297 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:32.948519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:32.963623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-88158d50-5355-4c7e-a8a0-bd15dc834e79 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.547965 Nov 21 17:15:32.966791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 102/208] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:32 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:33.185961 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:33.193593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:33.222300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:33.225037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:33.227697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:33.228495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:33.605420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:33.616708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8c0231c4-bcc6-4375-9559-6e447b79655d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.438200 Nov 21 17:15:33.617297 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 107/209] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:33 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:33.633528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:33.635576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:33.644289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:33.645763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:33.646764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:33.647354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:33.742734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d473211a-34da-410c-b252-c2b451f14747 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 17861 microversion: 2.20 time: 0.115080 Nov 21 17:15:33.743602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 103/210] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:33 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 17861 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:33.998755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:33.999807 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:34.008789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.009269 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.010106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.015898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.255125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-5bb6f4c1-74fc-4a58-9cb6-eb11fd04c317 req-a58b6d6e-4f6f-4adc-9ca4-3b6213fa6d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d670d19-5be0-4a50-a4fa-028b4bf0c165", "tag": "fe30213e-c636-462d-a3c7-987c00c238b0"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:34.258734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:34.258734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:34.271921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-5bb6f4c1-74fc-4a58-9cb6-eb11fd04c317 req-a58b6d6e-4f6f-4adc-9ca4-3b6213fa6d5d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.272926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-5bb6f4c1-74fc-4a58-9cb6-eb11fd04c317 req-a58b6d6e-4f6f-4adc-9ca4-3b6213fa6d5d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.337551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:34.338277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-5bb6f4c1-74fc-4a58-9cb6-eb11fd04c317 req-a58b6d6e-4f6f-4adc-9ca4-3b6213fa6d5d service nova] Creating event network-changed:fe30213e-c636-462d-a3c7-987c00c238b0 for instance 0d670d19-5be0-4a50-a4fa-028b4bf0c165 on hv-cinder-81869 Nov 21 17:15:34.345287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-5bb6f4c1-74fc-4a58-9cb6-eb11fd04c317 req-a58b6d6e-4f6f-4adc-9ca4-3b6213fa6d5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104201 Nov 21 17:15:34.347495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 104/211] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:34.348813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-49c775c5-29bf-4793-920e-6c0731dbe960 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.355900 Nov 21 17:15:34.360926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 108/212] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:33 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:34.649432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:34.650258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:34.666021 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.668099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.670740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.672308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.757883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:34.759450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:34.772729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.773187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.773995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:34.774496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:34.916027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e50dedf4-f451-4004-bf64-0b5d4d2e87df tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 18777 microversion: 2.20 time: 0.161697 Nov 21 17:15:34.918152 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 109/213] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:34 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 18777 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:34.970949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:34.999098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d47d5f2c-ff2f-42ff-825e-829499520611 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.353883 Nov 21 17:15:35.000018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 105/214] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:34 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:35.368515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:35.369234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:35.377180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:35.378341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:35.379452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:35.380078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:35.532823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:35.543286 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c8439127-22e0-4529-8854-4599480422f4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.180054 Nov 21 17:15:35.544653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 110/215] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:35 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:35.938155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:35.940903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:35.957325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:35.958488 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:35.960302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:35.961332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:36.023251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:36.025563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:36.035585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:36.036716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:36.038018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:36.038950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:36.116878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fcd95525-8d23-4885-b8a3-d7b342733c26 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 20272 microversion: 2.20 time: 0.185948 Nov 21 17:15:36.118116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 106/216] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:35 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 20272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:36.206972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:36.215763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a675ef30-7ef5-4d03-b877-dfeb74034694 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.199993 Nov 21 17:15:36.216664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 111/217] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:36 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:36.573885 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:36.574917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:36.592088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:36.593513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:36.595750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:36.597357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:36.962330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:36.990417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ed5a00cc-c964-40db-b072-4d46a9b182a4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.423478 Nov 21 17:15:37.006784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 107/218] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:36 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:37.129414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:37.130992 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:37.149474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:37.155481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:37.157184 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:37.157965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:37.242121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:37.243207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:37.271237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:37.272607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:37.274454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:37.275554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:37.670563 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:37.693359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-31eef65d-cd9b-4e1f-8c55-f99e1a8e94ab tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.447484 Nov 21 17:15:37.700413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:37 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:38.021130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:38.022245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:38.031914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:38.033730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:38.034306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:38.034778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:38.350140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:38.361485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b80d2ddd-e3fa-498b-9c2b-3fb6b89eaaa5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.345295 Nov 21 17:15:38.377067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 109/220] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:38 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:38.717980 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:38.718973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:38.733605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:38.734195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:38.735111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:38.738263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:39.047749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:39.074033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4410aadc-8eae-4157-af38-69f2fa8bad1f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.359499 Nov 21 17:15:39.113737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 110/221] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:38 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:39.215924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ad304661-c9a1-4023-aab5-d7f5d47b71e5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 24405 microversion: 2.20 time: 2.090345 Nov 21 17:15:39.221294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 112/222] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:37 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 24405 bytes in 2096 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:39.403238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:39.405337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:39.434240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:39.437248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:39.440757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:39.443876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:39.906397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:39.917024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2d747e3b-d519-49c1-be99-cc801d4aa96d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.536187 Nov 21 17:15:39.926738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 111/223] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:39 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:40.128703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:40.129418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:40.139926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.140372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:40.146109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.147299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:40.244091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:40.246017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:40.261926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.266540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:40.267616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.267997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:40.426058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ddeb6caa-b86c-4ec9-a595-f8d32a326eee tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 25372 microversion: 2.20 time: 0.200882 Nov 21 17:15:40.427255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 112/224] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:40 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 25372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:40.935909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:40.936909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:40.953203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.954873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:40.955997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:40.960118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:41.483021 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:41.495680 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7f5a5944-6457-434f-ab2e-04b55a557ed3 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 1.371056 Nov 21 17:15:41.511139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 113/225] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:40 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:41.533447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:41.534954 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:41.550459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:41.554692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:41.559909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:41.560564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:41.642109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:41.655317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-276d40e4-741d-48f4-a656-6361a6f9f4f7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.723042 Nov 21 17:15:41.657213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 113/226] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:40 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:41.718508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8a8413f7-0c82-4f94-ab8f-ac34200af934 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 26402 microversion: 2.20 time: 0.204738 Nov 21 17:15:41.729210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 114/227] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:41 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 26402 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:41.985146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-97e443ac-42f7-437d-8b49-1ff1b9c8c3fb req-65990252-23dd-4220-98b5-27a6597e90cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d670d19-5be0-4a50-a4fa-028b4bf0c165", "name": "network-vif-plugged", "status": "completed", "tag": "fe30213e-c636-462d-a3c7-987c00c238b0"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:41.986858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:41.986858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:42.028429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-97e443ac-42f7-437d-8b49-1ff1b9c8c3fb req-65990252-23dd-4220-98b5-27a6597e90cc service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.028868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-97e443ac-42f7-437d-8b49-1ff1b9c8c3fb req-65990252-23dd-4220-98b5-27a6597e90cc service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.069441 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-97e443ac-42f7-437d-8b49-1ff1b9c8c3fb req-65990252-23dd-4220-98b5-27a6597e90cc service nova] Creating event network-vif-plugged:fe30213e-c636-462d-a3c7-987c00c238b0 for instance 0d670d19-5be0-4a50-a4fa-028b4bf0c165 on hv-cinder-81869 Nov 21 17:15:42.087140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-97e443ac-42f7-437d-8b49-1ff1b9c8c3fb req-65990252-23dd-4220-98b5-27a6597e90cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108246 Nov 21 17:15:42.091040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 114/228] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:42.520505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:42.524327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:42.532849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.546717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.547795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.548276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.693973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:42.699940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:42.742981 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.748523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.754946 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.759342 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.856621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:42.874835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-acc10508-1066-4172-8697-388872649314 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.363397 Nov 21 17:15:42.876747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 115/229] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:42 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:42.890747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:42.892086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:42.903476 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.907316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:42.910011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:42.911356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:43.036752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2477c8ec-2ddd-4dbf-914c-7cc968b99e13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 27098 microversion: 2.20 time: 0.158206 Nov 21 17:15:43.037565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 116/230] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:42 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 27098 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:43.250158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:43.272825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b47fb1e5-ece7-4a21-9305-049f9006da3d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.588482 Nov 21 17:15:43.274947 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 115/231] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:42 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:43.899435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:43.900522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:43.912682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:43.913135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:43.914020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:43.915183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:44.049692 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:44.050942 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:44.067542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:44.068529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:44.070213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:44.072795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:44.229189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-37cc904b-6ddb-447f-b015-899789b6daed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 27357 microversion: 2.20 time: 0.182940 Nov 21 17:15:44.230419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 116/232] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:44 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 27357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:44.297472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:44.304345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:44.307654 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:44.311180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b50cc884-5f99-4812-a0ad-77581e4cceb7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1318 microversion: 2.1 time: 0.419243 Nov 21 17:15:44.313026 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 117/233] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:43 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:44.352183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:44.352641 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:44.353491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:44.353963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:44.748555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:44.789701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c0f8ae4d-2d79-4e7a-9962-95f26040a6e3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.502321 Nov 21 17:15:44.790475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 117/234] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:44 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:45.242784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:45.243889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:45.269737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.271599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.273942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.275084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.339425 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:45.340137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:45.351381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.351811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.352837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.352989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.423709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ec3631a0-778f-4bfb-8d4f-51b2329a95b8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 27561 microversion: 2.20 time: 0.185127 Nov 21 17:15:45.428785 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 118/235] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:45 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 27561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:45.726518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:45.744699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a84bb777-96f1-486a-b870-4960a03fc4ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1508 microversion: 2.1 time: 0.408943 Nov 21 17:15:45.746449 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 118/236] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:45 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:45.763504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b81014c-24b2-4645-a8a5-5dc2348ad188"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:45.768218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:45.786117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.786562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.787380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.787814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.960353 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Invalid volume: volume 2b81014c-24b2-4645-a8a5-5dc2348ad188 is already attached to instances: e3c4fbff-6877-43aa-ba5b-636ee99304f9 Nov 21 17:15:45.961058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 400 to user: Invalid volume: volume 2b81014c-24b2-4645-a8a5-5dc2348ad188 is already attached to instances: e3c4fbff-6877-43aa-ba5b-636ee99304f9 {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:15:45.962684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-90a86dfc-8e8d-49f8-b040-2b5cfa1c076d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.203377 Nov 21 17:15:45.963259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 119/237] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:15:45 2021] POST /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165/os-volume_attachments => generated 174 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 21 17:15:45.968935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:45.969889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:45.977440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.978241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:45.979419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:45.980614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.141789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:46.151766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bb7904af-e6ae-4bd3-8e50-a6be195f26e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.185396 Nov 21 17:15:46.152391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 120/238] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:45 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:46.157225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:46.157887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:46.165391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.166254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.167743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.168326 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.333538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lazy-loading 'services' on Instance uuid e3c4fbff-6877-43aa-ba5b-636ee99304f9 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:15:46.436289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'create', calling method: .version_select at 0x7f1fbda9fb80>, body: {"keypair": {"name": "tempest-keypair-317306131"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:46.483597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:15:46.505194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-56a1d566-1476-4467-a286-5d0544e52ab9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments/2b81014c-24b2-4645-a8a5-5dc2348ad188" status: 202 len: 0 microversion: 2.1 time: 0.350719 Nov 21 17:15:46.508933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 121/239] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:15:46 2021] DELETE /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments/2b81014c-24b2-4645-a8a5-5dc2348ad188 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:46.520880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:15:46.531167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:46.536226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:46.561314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.563898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.564966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.567391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.692008 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c41e9bc3-4b79-4a2f-97eb-4a1085f1b857 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28090 microversion: 2.20 time: 0.184912 Nov 21 17:15:46.697606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 122/240] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:46 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28090 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:46.706292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:46.710403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:46.730642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.731394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.732596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:46.736075 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:46.821092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5f9e4cb8-d669-46b0-9b09-78e0d914be14 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115174 Nov 21 17:15:46.823013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 123/241] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:15:46 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:47.169400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:47.169950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:47.185149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.185600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.186381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.186853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.570597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:47.588634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-977e61e6-44a0-4eed-8382-3a69ed72a113 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.423236 Nov 21 17:15:47.601151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 124/242] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:47 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:47.709293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:47.711405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:47.732998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.740872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.746231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.749831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.761544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:15:47.767742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:15:47.798601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1caaf29b-70b7-4888-b00a-92a9e51c9f36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 2.222606 Nov 21 17:15:47.799519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 119/243] 10.222.0.52 () {60 vars in 1157 bytes} [Sun Nov 21 17:15:45 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:47.834533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:47.837309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:47.867060 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e0ad9d76-cbf8-4fb1-9c83-f49e54f56fce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28149 microversion: 2.20 time: 0.165659 Nov 21 17:15:47.868053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 125/244] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:47 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28149 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:47.879012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.879629 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.890676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:47.895574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:47.975263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-eb7cce24-2a2b-41d6-bbf4-566e484af9a9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145202 Nov 21 17:15:47.975847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 120/245] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:15:47 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 17:15:48.313729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2117464250", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "3e685649-08ee-406b-ab8b-0039878e0276"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:48.421297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] validate_networks() for [('3e685649-08ee-406b-ab8b-0039878e0276', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:15:48.620868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:48.622381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:48.634652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:48.635700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:48.639699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:48.640538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:48.984128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:48.996810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-88ab43cc-487d-4c19-b8a2-069bf85d9224 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.381344 Nov 21 17:15:48.997687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 121/246] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:48 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:49.022161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:49.023601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:49.046082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:49.047522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:49.049303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:49.051764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:49.175783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a8b69a24-d251-48c6-9c2c-3e55c1383735 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28149 microversion: 2.20 time: 0.173030 Nov 21 17:15:49.178210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 122/247] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:48 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28149 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:49.515361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:15:49.515898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:15:49.516316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:15:49.516730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:15:49.517171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:15:49.536547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:49.537498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:49.538410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:49.539170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:49.567262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:15:49.575602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for user 4c6cd4fc3c724700b710d79faca5e698 and project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:15:49.592659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:15:49.595699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:15:49.705903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-91dcdd53-271b-4953-8f12-d0a86646b66d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400526 Nov 21 17:15:49.712720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 126/248] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:15:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:15:49.723285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d101447d-985c-433b-8e0c-e73e535b89cb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:49.723995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d101447d-985c-433b-8e0c-e73e535b89cb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:49.887983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d101447d-985c-433b-8e0c-e73e535b89cb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:49.915872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d101447d-985c-433b-8e0c-e73e535b89cb tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1218 microversion: 2.1 time: 0.196349 Nov 21 17:15:49.930867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 123/249] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:49 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:50.020207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:50.021184 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:50.031530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.032254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:50.034608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.035917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:50.189790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:50.191727 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:50.204783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.205612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:50.209092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.209772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:50.340076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b9c5fb13-21c9-49a6-89e8-5416fdb2fb57 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28439 microversion: 2.20 time: 0.154089 Nov 21 17:15:50.345416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 124/250] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:50 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:50.520303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:50.530883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-30f29d34-e0cc-4190-a1a4-911d91535967 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.519914 Nov 21 17:15:50.544628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 127/251] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:50 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:50.911317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-511123686", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "081dfc56-aafd-485f-9f9b-45b7fc1568a4"}], "security_groups": [{"name": "tempest-securitygroup--1087791850"}], "key_name": "tempest-keypair-317306131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:50.948225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:50.948840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:50.956475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.956927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:50.957691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:50.958118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.093809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:51.102922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1c237536-9095-4d9d-9c61-a3b0bff6aa27 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1270 microversion: 2.1 time: 0.158246 Nov 21 17:15:51.104873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 128/252] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:50 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:51.155630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] validate_networks() for [('081dfc56-aafd-485f-9f9b-45b7fc1568a4', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:15:51.361167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:51.364316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:51.396587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.397165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.399601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.400542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.527447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7c699851-7cd3-40a3-8833-3f9404ab0f2d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28606 microversion: 2.20 time: 0.176651 Nov 21 17:15:51.529726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 129/253] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:51 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28606 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:15:51.550858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:51.551932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:51.567180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.570521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.571696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.575796 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.922243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:51.933622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a14baa90-26cf-4e9a-9ac3-4bddb158f195 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1521 microversion: 2.1 time: 0.387923 Nov 21 17:15:51.934948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 130/254] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:51 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:51.946401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:15:51.947005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:15:51.947296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:15:51.947694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:15:51.948397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:15:51.961724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.965757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:51.966742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:51.971685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.023848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:15:52.029118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:15:52.042459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:15:52.047492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:15:52.123750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:52.124464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:52.132756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.133322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.134188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.134639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.170295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-269ac812-30c6-4caa-bd79-e59ee4d4869f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.263501 Nov 21 17:15:52.171587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 125/255] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:15:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:15:52.181338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e492f1f5-84c3-48ed-8254-b8e40d3790bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:52.182881 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e492f1f5-84c3-48ed-8254-b8e40d3790bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:52.300329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:52.317787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e492f1f5-84c3-48ed-8254-b8e40d3790bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:52.328796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e492f1f5-84c3-48ed-8254-b8e40d3790bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1236 microversion: 2.1 time: 0.150920 Nov 21 17:15:52.330017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8c2dfbb3-6ed9-489e-b3c9-1e40c85fb0c7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1276 microversion: 2.1 time: 0.211925 Nov 21 17:15:52.339208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 131/256] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:52 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:52.340355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 126/257] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:52 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1236 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:52.542368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:52.543526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:52.557464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.557920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.560986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.562372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.644482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-da0650f7-f970-47fb-976b-5fb635872af6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28606 microversion: 2.20 time: 0.106394 Nov 21 17:15:52.650080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 132/258] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:52 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28606 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:52.952180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:52.952859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:52.967413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.968208 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:52.973068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:52.973768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.126904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:53.135995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bd22245a-ed02-4780-92c9-e34cf3517f56 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1501 microversion: 2.1 time: 0.187696 Nov 21 17:15:53.136567 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 127/259] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:52 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:53.162123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:53.163333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:53.173412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.174250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.175394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.176017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.356558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:53.357177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:53.370492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:53.375837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.376503 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.377361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.379360 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.381719 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a8137b9a-8e9c-4a46-8aaa-e3ecbbe9bab4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1515 microversion: 2.1 time: 0.229295 Nov 21 17:15:53.382645 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 133/260] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:53 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:53.388174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:53.389194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:53.399987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.401944 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.403639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.405881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.493250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:53.505792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a1a6cc21-0e04-4c1b-8940-e9a8c1c0121e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1288 microversion: 2.1 time: 0.120527 Nov 21 17:15:53.516817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 134/261] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:53 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1288 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:53.658898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:53.660439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:53.677889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.678904 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.681219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.682887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.701806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:53.731832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-aece0ed9-0bd3-40bf-8d77-94154e10b393 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.379542 Nov 21 17:15:53.734441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 128/262] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:53 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:53.797460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-98a8153c-f579-4f5e-b159-21b72d5835c1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28606 microversion: 2.20 time: 0.144180 Nov 21 17:15:53.799605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 135/263] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:53 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28606 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:53.901558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-a2e4cebe-f898-4565-b8eb-6d5e9c4289ce req-b0d6e597-33de-4632-8a0b-0ae976f5ddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4345c73b-e834-49e9-9b9c-240c14efda0d", "tag": "1d359723-7062-4d6d-a38a-ef4301c71739"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:53.903512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:53.903512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:15:53.918684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a2e4cebe-f898-4565-b8eb-6d5e9c4289ce req-b0d6e597-33de-4632-8a0b-0ae976f5ddd9 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:53.919536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a2e4cebe-f898-4565-b8eb-6d5e9c4289ce req-b0d6e597-33de-4632-8a0b-0ae976f5ddd9 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:53.949091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-a2e4cebe-f898-4565-b8eb-6d5e9c4289ce req-b0d6e597-33de-4632-8a0b-0ae976f5ddd9 service nova] Creating event network-changed:1d359723-7062-4d6d-a38a-ef4301c71739 for instance 4345c73b-e834-49e9-9b9c-240c14efda0d on hv-cinder-81869 Nov 21 17:15:53.959699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-a2e4cebe-f898-4565-b8eb-6d5e9c4289ce req-b0d6e597-33de-4632-8a0b-0ae976f5ddd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064426 Nov 21 17:15:53.962678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 129/264] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:54.524189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:54.525162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:54.540962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.542157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.543312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.543863 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.615528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:54.641269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4bac01fd-d6df-4619-b80d-2ad1983a3db0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1294 microversion: 2.1 time: 0.120940 Nov 21 17:15:54.642291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 136/265] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:54 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:54.752313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:54.753090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:54.761982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.762430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.763281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.763709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.817127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:54.820659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:54.829189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.829940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.833284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:54.834363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:54.923251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-482e3ab9-5d37-4b2e-936a-474f5de9ecd8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28606 microversion: 2.20 time: 0.112992 Nov 21 17:15:54.925212 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 137/266] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:54 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28606 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:55.068305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:55.083863 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4d6b8516-0f22-4df9-b356-f37de436989b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.335362 Nov 21 17:15:55.084972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 130/267] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:54 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:55.449399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:55.450640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:55.458260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.458739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.459906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.460291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.490365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lazy-loading 'flavor' on Instance uuid 7a5eddea-80da-4ad2-a69a-4150ee61891a {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:15:55.579568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b2ca6ee5-8b64-4843-8111-ebb204168e4e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action" status: 200 len: 32 microversion: 2.1 time: 0.135277 Nov 21 17:15:55.580301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 138/268] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:15:55 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 17:15:55.592056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:55.592981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:55.600127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.600855 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.601793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.602413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.662972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:55.664114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:55.672803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.673698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.674905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:55.676311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:55.968780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:55.982810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-654e3bfc-b554-42d3-ba5b-540c99921fb3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.395541 Nov 21 17:15:55.985060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 131/269] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:55 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:55.990260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:55.991719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:56.017849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:56.018389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:56.019261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:56.019693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:56.085178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:56.095654 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f12fc359-d6ca-4b63-97f6-c614e673de52 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.437463 Nov 21 17:15:56.103449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3507caa7-e915-4ded-a23b-98b0fe58473c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28606 microversion: 2.20 time: 0.116722 Nov 21 17:15:56.104814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 132/270] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:55 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:56.110858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 139/271] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:55 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:15:56.112488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:56.113201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:56.121791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:56.122238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:56.123062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:56.123497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:56.332199 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-eb1733f1-057e-4e17-9b1f-9a89972c4db4 req-de769bda-baa3-4d81-b525-d2d7db72b9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b914fc-c9f9-436e-9895-ca4fd17481c4", "tag": "858ad848-0f28-45d6-9e17-0e58fd716a04"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:56.334165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:56.334165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:56.342492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-eb1733f1-057e-4e17-9b1f-9a89972c4db4 req-de769bda-baa3-4d81-b525-d2d7db72b9fb service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:56.343308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-eb1733f1-057e-4e17-9b1f-9a89972c4db4 req-de769bda-baa3-4d81-b525-d2d7db72b9fb service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:56.361898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-eb1733f1-057e-4e17-9b1f-9a89972c4db4 req-de769bda-baa3-4d81-b525-d2d7db72b9fb service nova] Creating event network-changed:858ad848-0f28-45d6-9e17-0e58fd716a04 for instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 on hv-cinder-81869 Nov 21 17:15:56.370487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-eb1733f1-057e-4e17-9b1f-9a89972c4db4 req-de769bda-baa3-4d81-b525-d2d7db72b9fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042313 Nov 21 17:15:56.371819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 140/272] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:56.446260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:56.464169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f57bd6f-61c6-42e9-987d-94d09eaa161b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.356908 Nov 21 17:15:56.464766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 133/273] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:56 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:57.004562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:57.005435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:57.015857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.016610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.017988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.018585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.117563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:57.129050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:57.130537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.131125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.132027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.132693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.410022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:57.433477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0a2bbe05-e567-4da9-a1f5-8049b4b53cf6 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.431921 Nov 21 17:15:57.434808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 141/274] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:56 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:57.451128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:57.452431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:57.461222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.462177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.464322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.465192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.482157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:57.499127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-94866fa3-6c00-479e-ace2-efa885585199 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.387117 Nov 21 17:15:57.500932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 134/275] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:57 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:57.512198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:57.513274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:57.523639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.524299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.525612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:57.526346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:57.609678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6aec38e1-c230-4b9f-8e33-797f46bc1768 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 28807 microversion: 2.20 time: 0.171898 Nov 21 17:15:57.610741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 142/276] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:57 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 28807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:57.983867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:57.996262 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-60491966-6174-4bf8-9286-01caa323552f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.492663 Nov 21 17:15:57.996525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 135/277] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:57 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:58.454216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:58.454976 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:58.461624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.462070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.462879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.463850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.525706 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:58.527058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:58.533226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.533674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.534442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.534912 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.619737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:58.627408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-32fce801-f44c-4874-9863-d728cd08ca8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.177444 Nov 21 17:15:58.627984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 143/278] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:58 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:58.632365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:58.633261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:58.640645 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.641097 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.641897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:58.642305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:58.681466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:58.690134 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-12220abe-f5b4-4b69-bb61-a2f2255a5e9d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.167967 Nov 21 17:15:58.690799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 136/279] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:58 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:58.735161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4c03a332-c78d-415b-9d45-78e3ef73dc13 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 29686 microversion: 2.20 time: 0.105865 Nov 21 17:15:58.735812 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 144/280] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:15:58 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 29686 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:15:59.014471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:59.014471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:59.020798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.021534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.022255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.022891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.160148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:15:59.167877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0812e651-c138-4f40-9a7a-1326d41f5c2a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.158686 Nov 21 17:15:59.168440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 137/281] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:59 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:15:59.630848 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-9ab5a93d-98fa-4637-a738-9a7fd6bf1628 req-07fbe439-ab18-47b7-b734-c5098721b461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345c73b-e834-49e9-9b9c-240c14efda0d", "name": "network-vif-plugged", "status": "completed", "tag": "1d359723-7062-4d6d-a38a-ef4301c71739"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:15:59.635983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:15:59.635983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:15:59.649362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9ab5a93d-98fa-4637-a738-9a7fd6bf1628 req-07fbe439-ab18-47b7-b734-c5098721b461 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.650847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9ab5a93d-98fa-4637-a738-9a7fd6bf1628 req-07fbe439-ab18-47b7-b734-c5098721b461 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.651620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:59.654243 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:59.667710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.668470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.669815 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.670867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.676775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-9ab5a93d-98fa-4637-a738-9a7fd6bf1628 req-07fbe439-ab18-47b7-b734-c5098721b461 service nova] Creating event network-vif-plugged:1d359723-7062-4d6d-a38a-ef4301c71739 for instance 4345c73b-e834-49e9-9b9c-240c14efda0d on hv-cinder-81869 Nov 21 17:15:59.700761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-9ab5a93d-98fa-4637-a738-9a7fd6bf1628 req-07fbe439-ab18-47b7-b734-c5098721b461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081973 Nov 21 17:15:59.702584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 145/282] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:15:59.724026 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:15:59.725865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:15:59.748306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.749103 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.751126 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:15:59.752166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:15:59.996447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:00.028582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-969af48d-b576-4688-a935-0c09cd67ef10 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.378719 Nov 21 17:16:00.032510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 138/283] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:59 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:00.041540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:00.044512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:00.056095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:00.057636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:00.059519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:00.061715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:00.210932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ba4e9ba3-b46e-426d-88cb-52ea5a58e78f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 31090 microversion: 2.20 time: 0.176096 Nov 21 17:16:00.212142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 139/284] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:00 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 31090 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:00.216845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:00.218075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:00.218904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:00.225988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-421c48e8-5d03-45cc-8961-790bfc8a41da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.519759 Nov 21 17:16:00.226609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:00.227794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:00.230146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:00.230713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 146/285] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:15:59 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:00.231694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:00.424700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:00.437619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fe83f4ce-a60d-431b-9b0a-77608ecff8d5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.223952 Nov 21 17:16:00.438218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 140/286] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:00 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:01.080964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:01.082529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:01.095418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.096125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.097231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.097943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.227937 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:01.230093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:01.240783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.241534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.242977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.243715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.336823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:01.351837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5df3ac75-602a-46c5-b2b7-76eaf98f4004 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.277441 Nov 21 17:16:01.352433 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 147/287] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:01 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:01.364903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:01.366131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:01.372117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-96dd4b4f-34aa-4715-9775-ba8876c5d41c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 31789 microversion: 2.20 time: 0.150600 Nov 21 17:16:01.373382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 141/288] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:01 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 31789 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:01.387707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.388523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.389971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.390781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.458087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:01.458851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:01.468186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.468638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.469413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.469839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.673610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:01.684477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fbc73001-246a-4b1b-9a11-12ae95e5210c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.329506 Nov 21 17:16:01.685856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 148/289] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:01 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:01.750431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-53bf64e6-2944-4400-a4f7-199b3d28b877 req-2f1a7fb8-11dd-4c11-a3ba-fa7ec7f194f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b914fc-c9f9-436e-9895-ca4fd17481c4", "name": "network-vif-plugged", "status": "completed", "tag": "858ad848-0f28-45d6-9e17-0e58fd716a04"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:01.752257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:16:01.752257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:16:01.772003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-53bf64e6-2944-4400-a4f7-199b3d28b877 req-2f1a7fb8-11dd-4c11-a3ba-fa7ec7f194f2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:01.772418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-53bf64e6-2944-4400-a4f7-199b3d28b877 req-2f1a7fb8-11dd-4c11-a3ba-fa7ec7f194f2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:01.784521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:01.797254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-53bf64e6-2944-4400-a4f7-199b3d28b877 req-2f1a7fb8-11dd-4c11-a3ba-fa7ec7f194f2 service nova] Creating event network-vif-plugged:858ad848-0f28-45d6-9e17-0e58fd716a04 for instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 on hv-cinder-81869 Nov 21 17:16:01.803392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-53bf64e6-2944-4400-a4f7-199b3d28b877 req-2f1a7fb8-11dd-4c11-a3ba-fa7ec7f194f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057589 Nov 21 17:16:01.804072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 149/290] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:01.831355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-54e67db6-5514-4c5c-a389-70413976c3f7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1318 microversion: 2.1 time: 0.378697 Nov 21 17:16:01.832407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:01 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:02.373894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:02.374875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:02.384837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.386503 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.387051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:02.387805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.388134 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:02.388511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.394825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.395278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.396066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.396500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.517934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e05a31bf-f218-4076-9d6b-186a5fbc6262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 32334 microversion: 2.20 time: 0.134825 Nov 21 17:16:02.519089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 143/292] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:02 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 32334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:02.535481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:02.543725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9a4b5796-ab9b-4c9c-9b32-3ecdeb5b4cc8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.174070 Nov 21 17:16:02.544304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 150/293] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:02 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:02.705055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:02.706031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:02.716787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.717804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.719402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.720359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.849568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:02.850688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:02.864605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.866818 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.871059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:02.872327 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:02.904139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:02.920437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d42040fb-682f-4edd-acf3-c000964fbae1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1362 microversion: 2.1 time: 0.220352 Nov 21 17:16:02.932600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 144/294] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:02 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:03.089621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:03.105537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-66b7367b-8e7f-47a2-bc03-5de50cc63c98 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1508 microversion: 2.1 time: 0.259421 Nov 21 17:16:03.106445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 151/295] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:02 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:03.533701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:03.546840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:03.553645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.554140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:03.555082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.555450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:03.573438 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:03.574790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:03.591786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.592800 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:03.594290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.611308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:03.759339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-82a614e7-bf14-49c2-9d21-d6f7ad368672 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 32921 microversion: 2.20 time: 0.229102 Nov 21 17:16:03.760833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 145/296] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:03 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 32921 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:03.954804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:03.957418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:03.961734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:03.972213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d309483c-7ac8-4f4b-a8a3-8e727c01a116 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.403123 Nov 21 17:16:03.976531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.977321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 152/297] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:03 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:03.978076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:03.979788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:03.980321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:04.184128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:04.193531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f8f4ee9a-9c5e-465d-926b-e8bab30255a7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1548 microversion: 2.1 time: 0.244543 Nov 21 17:16:04.194435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 146/298] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:03 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1548 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:04.224176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:04.225037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:04.235427 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:04.236447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:04.237267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:04.238029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:04.400059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cd276d1e-204e-4027-ad61-9dbbd3a099da tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182927 Nov 21 17:16:04.401945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 153/299] 10.222.0.52 () {58 vars in 1274 bytes} [Sun Nov 21 17:16:04 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:04.774584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:04.777008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:04.787847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:04.789160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:04.791052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:04.793516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:04.931320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9438af21-0197-497a-9888-7cfff7bd0132 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 33383 microversion: 2.20 time: 0.160812 Nov 21 17:16:04.934505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 147/300] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:04 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 33383 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:05.005093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:05.005923 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:05.015077 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.017104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:05.017104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.017104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:05.067612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9842053-605a-4f6e-9d95-c6cc3b32af07"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:05.069073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:05.079562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.080307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:05.081436 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.082159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:05.450163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dd33e341-6ea1-4cc7-a325-2597387c136b tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390171 Nov 21 17:16:05.450951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 148/301] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:16:05 2021] POST /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:05.905031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:05.913306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a10b1b6c-0ec7-4eec-a3f0-9a1bff53619e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.913374 Nov 21 17:16:05.924569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 154/302] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:04 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:05.949548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:05.950820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:05.958929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.959710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:05.960611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:05.961276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:06.059101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3ee18e40-c3f0-48da-8189-1abbb8ee2620 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 33915 microversion: 2.20 time: 0.113685 Nov 21 17:16:06.059907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 149/303] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:05 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 33915 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:06.857179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:06.859747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:06.866242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-03fae74e-5a07-4436-890d-c4b2ec791ecf req-71fcd81e-8714-4b78-b2c1-565787c1a3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b914fc-c9f9-436e-9895-ca4fd17481c4", "tag": "858ad848-0f28-45d6-9e17-0e58fd716a04"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:06.869839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:16:06.869839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:16:06.891272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:06.894253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:06.895689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:06.897325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:06.899190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-03fae74e-5a07-4436-890d-c4b2ec791ecf req-71fcd81e-8714-4b78-b2c1-565787c1a3a2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:06.902929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-03fae74e-5a07-4436-890d-c4b2ec791ecf req-71fcd81e-8714-4b78-b2c1-565787c1a3a2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:06.939908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-03fae74e-5a07-4436-890d-c4b2ec791ecf req-71fcd81e-8714-4b78-b2c1-565787c1a3a2 service nova] Creating event network-changed:858ad848-0f28-45d6-9e17-0e58fd716a04 for instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 on hv-cinder-81869 Nov 21 17:16:06.946767 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-03fae74e-5a07-4436-890d-c4b2ec791ecf req-71fcd81e-8714-4b78-b2c1-565787c1a3a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100651 Nov 21 17:16:06.951211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 150/304] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:16:06.968012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:06.970247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:06.982168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:06.983140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:06.984731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:06.985355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:07.018962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-15789bfc-a6e8-4add-8ffa-0fccd42917d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.187977 Nov 21 17:16:07.019914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 155/305] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:06 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:07.073869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:07.079389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:07.086828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:07.087607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:07.088709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:07.089564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:07.210881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-702683b9-cd85-4cef-828d-546295f549dc tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 34819 microversion: 2.20 time: 0.141213 Nov 21 17:16:07.217859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 156/306] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:07 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 34819 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:07.516207 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:07.532749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fc73479c-7f35-4d4d-872d-c512966c30fc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.577613 Nov 21 17:16:07.534454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 151/307] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:06 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:08.033599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:08.034973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:08.056694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.057210 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.058023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.058494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.181693 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0729ccb4-2a7d-4a82-9835-0c9da5fbb0ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.152344 Nov 21 17:16:08.186100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 157/308] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:08 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 17:16:08.227169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:08.228466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:08.236933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.237543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.238429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.238960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.349085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e67fcdc5-3717-4263-8bb6-5c79a0279cd7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 35493 microversion: 2.20 time: 0.126334 Nov 21 17:16:08.352060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 152/309] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:08 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 35493 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:08.559555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:08.560589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:08.568148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.569020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.570082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:08.570790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:08.777048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:08.808397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0fb53afc-1b52-4cdf-99cc-0755bf64a709 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.253076 Nov 21 17:16:08.809553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 158/310] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:08 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:09.203228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:09.205385 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:09.222587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.223474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:09.225104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.225874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:09.315538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bf19852a-7429-42de-88ea-200d80e0182c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.121744 Nov 21 17:16:09.319185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 153/311] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:09 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:09.367377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:09.368821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:09.376660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.377114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:09.377910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.378345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:09.485106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-86a589a1-2bec-4f48-a77d-208d56b214d7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 36469 microversion: 2.20 time: 0.122717 Nov 21 17:16:09.485867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 159/312] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:09 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 36469 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:09.829348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:09.830429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:09.837828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.838919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:09.840073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:09.840518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:10.065963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:10.082794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-efe2b185-6b88-41de-8e88-29f3c06ea5af tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.255954 Nov 21 17:16:10.084014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 154/313] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:09 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:10.331242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:10.332680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:10.340049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:10.340838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:10.341779 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:10.342224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:10.446171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cd307917-b836-40a6-8119-692df878c720 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.120893 Nov 21 17:16:10.448051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 160/314] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:10 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:10.503092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:10.512562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:10.528528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:10.529768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:10.531886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:10.532887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:10.655789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7b6e69d7-4381-4fd5-8be7-9c17b5d1e15c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 37493 microversion: 2.20 time: 0.159785 Nov 21 17:16:10.656748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 155/315] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:10 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 37493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:11.112133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:11.113195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:11.122486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.123134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.124194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.124684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.302535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:11.313556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-44be5fe6-3114-4685-a4a4-7799f3e08b59 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.207012 Nov 21 17:16:11.318255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 161/316] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:11 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:11.462589 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:11.464961 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:11.477030 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.477816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.479380 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.480173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.575287 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8193f719-ecd9-48ef-b5b5-a7911c8c3e36 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.120315 Nov 21 17:16:11.576384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 156/317] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:11 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:11.672499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:11.674337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:11.687027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.687788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.689330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:11.690736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:11.812799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4786ed1a-161f-456b-a3dc-68c294a6000e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 38052 microversion: 2.20 time: 0.147028 Nov 21 17:16:11.814572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 162/318] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:11 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 38052 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:12.341964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:12.343372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:12.357639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.358541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.359599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.360038 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.561867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:12.569666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9d6ce4d0-b7bf-471b-ae47-17894c99ada4 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.237421 Nov 21 17:16:12.570256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 157/319] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:12 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:12.590455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:12.591627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:12.598660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.599392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.600410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.600939 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.682938 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7042ceae-a145-4acd-80ae-8b61488bc102 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.096225 Nov 21 17:16:12.683941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 163/320] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:12 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:12.832490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:12.835174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:12.845656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.846976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.848406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:12.849148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:12.961272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e29a4282-175e-4b03-ab34-22414189cc84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 38105 microversion: 2.20 time: 0.136283 Nov 21 17:16:12.962536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 158/321] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:12 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 38105 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:13.368448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9842053-605a-4f6e-9d95-c6cc3b32af07"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:13.371278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.385495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.386398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.388099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.389548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.546169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Invalid volume: volume d9842053-605a-4f6e-9d95-c6cc3b32af07 is already attached to instances: 4345c73b-e834-49e9-9b9c-240c14efda0d Nov 21 17:16:13.546895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 400 to user: Invalid volume: volume d9842053-605a-4f6e-9d95-c6cc3b32af07 is already attached to instances: 4345c73b-e834-49e9-9b9c-240c14efda0d {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:16:13.547733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f8a73c8d-cdf2-47d5-a847-2f1159bf3ed5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.190523 Nov 21 17:16:13.548899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 164/322] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:16:13 2021] POST /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 21 17:16:13.590509 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:13.591972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.598734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.599566 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.600609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.601183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.649272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:13.650350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.662423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.663556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.665034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.666894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.802467 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:13.814690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-769c07b0-239b-4c36-b14c-b2f68509faa3 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.229303 Nov 21 17:16:13.822899 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 159/323] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:13 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:13.829946 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lazy-loading 'services' on Instance uuid 4345c73b-e834-49e9-9b9c-240c14efda0d {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:16:13.830516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:13.831471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.838571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.839481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.839993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.840438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.924606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5ebe70af-a0a9-4bed-889f-ec17e08e0f84 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.107494 Nov 21 17:16:13.925672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 160/324] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:13 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:13.937666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a8893b06-1f4b-4d92-914b-37a066991b7e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments/d9842053-605a-4f6e-9d95-c6cc3b32af07" status: 202 len: 0 microversion: 2.1 time: 0.295492 Nov 21 17:16:13.938363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 165/325] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:16:13 2021] DELETE /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments/d9842053-605a-4f6e-9d95-c6cc3b32af07 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:13.950975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:13.952946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.965464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.966163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.967454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.968049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.981669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:13.984450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:13.996581 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.997721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:13.999193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:13.999803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:14.033470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-59ca0bd3-b511-474f-b6aa-749362f9367d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088905 Nov 21 17:16:14.034135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 161/326] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:16:13 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:14.114840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0471ba51-ffdb-4107-91e3-aac9963af172 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 38121 microversion: 2.20 time: 0.140067 Nov 21 17:16:14.116358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 166/327] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:13 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 38121 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:14.839711 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:14.840910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:14.852310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:14.853217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:14.855641 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:14.856294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:14.954504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:14.956922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:14.975043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:14.975949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:14.977623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:14.979146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.069247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-86d20c39-c1d1-48d4-b04d-011d50244554 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.126797 Nov 21 17:16:15.070040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 167/328] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:14 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:15.077683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:15.078196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:15.079824 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:15.087618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.088592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.089688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.090172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.093142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1b756090-6e99-4d86-8672-a2f0c816a911 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.260626 Nov 21 17:16:15.094881 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 162/329] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:14 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:15.128719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:15.129813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:15.137427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.137975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.138906 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.139423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.144341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6c657615-5dd9-47a2-a824-ce62582a54d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072635 Nov 21 17:16:15.144927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 168/330] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:16:15 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:15.246279 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-679b9f77-e9eb-4ed3-8b5a-62e707ace3ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 200 len: 38248 microversion: 2.20 time: 0.120935 Nov 21 17:16:15.247667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 163/331] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:15 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 38248 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:15.261691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:15.262293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:15.269785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.270427 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.271509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:15.272055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:15.308148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9c5675b9-3007-4022-900b-f8bf0fc02112 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/ips" status: 200 len: 152 microversion: 2.20 time: 0.050900 Nov 21 17:16:15.308988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 169/332] 10.222.0.52 () {60 vars in 1288 bytes} [Sun Nov 21 17:16:15 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:15.364353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-581966153", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "3e685649-08ee-406b-ab8b-0039878e0276"}]}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:15.431317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] validate_networks() for [('3e685649-08ee-406b-ab8b-0039878e0276', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:16:15.990209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:16:15.991150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:16:15.991434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:16:15.991955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:16:15.992436 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:16:16.004465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.005230 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.006482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.007163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.029940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:16:16.036086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Getting quotas for user 4c6cd4fc3c724700b710d79faca5e698 and project 89340607dc524f939683b019c1853d95. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:16:16.049604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:16:16.052055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:16:16.087959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:16.090825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:16.097915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.098689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.099483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.100116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.117693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-63662977-4cee-43c7-b2e9-9bb48346b725 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757724 Nov 21 17:16:16.119845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 164/333] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:16:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 17:16:16.131261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:16.133023 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:16.148856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.161799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.162493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:16.163075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:16.240328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7c6412d3-c565-4b3f-83fb-f0994a2d7ae6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.158983 Nov 21 17:16:16.241753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 170/334] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:16 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 17:16:16.248721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c5ceeea9-603f-4ad6-8dfe-e7ad1a09a0f0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:16.250090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c5ceeea9-603f-4ad6-8dfe-e7ad1a09a0f0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:16.383945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c5ceeea9-603f-4ad6-8dfe-e7ad1a09a0f0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:16.399994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c5ceeea9-603f-4ad6-8dfe-e7ad1a09a0f0 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1217 microversion: 2.1 time: 0.156065 Nov 21 17:16:16.402182 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 171/335] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:16 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:16.446117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:16.456403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-86a62122-c97f-43e5-b726-64ff605bbccd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.334367 Nov 21 17:16:16.456986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:16 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:17.254970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:17.256444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:17.267121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.267710 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.268795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.269328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.359293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7cc7d034-c5df-43e5-935a-c1ba7b8e744a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.109352 Nov 21 17:16:17.360633 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 172/337] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:17 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:17.425758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:17.427164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:17.438289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.439052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.440519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.441316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.487736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:17.489042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:17.517321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.518131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.519827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:17.520682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:17.537957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:17.558449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7daaf90e-97c5-4d12-a211-4007410dc96e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1269 microversion: 2.1 time: 0.142510 Nov 21 17:16:17.561240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 166/338] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:17 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:17.889806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:17.904678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-28298167-6838-41e1-ad88-2a5e18eba330 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.432698 Nov 21 17:16:17.917309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 173/339] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:17 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:18.237736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:18.239920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:18.256418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.257870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.260445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.262689 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.333066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lazy-loading 'flavor' on Instance uuid 9a72ec97-159e-42a7-b4d8-b10ea675fb22 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:16:18.376666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:18.379415 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:18.408264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.412431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.414916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.418521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.543798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ce0c23d3-f237-420d-b2a4-bb2f04e9d7cd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.174481 Nov 21 17:16:18.544465 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 174/340] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:18 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 21 17:16:18.591163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:18.592309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:18.610334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.611087 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.612059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.615753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.934719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cd1adf7d-0152-4318-97da-25dd79a87714 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 202 len: 0 microversion: 2.20 time: 0.708223 Nov 21 17:16:18.940316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 167/341] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:16:18 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:16:18.955661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:18.956836 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:18.967872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.968236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:18.969399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:18.969905 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:19.043653 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:19.053570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5f5b8052-2031-4589-86a1-4c88ace287d1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1275 microversion: 2.1 time: 0.471764 Nov 21 17:16:19.054844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 175/342] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:18 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1275 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:19.063448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:19.065515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:19.073894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:19.074928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:19.076116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:19.076663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:19.276798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:19.299730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5371dd98-3fa8-466b-8916-6ca947cbf21a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.353077 Nov 21 17:16:19.301206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 168/343] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:18 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:19.488304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:19.500605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:19.504274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:19.506771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a67412e2-6668-4254-92a1-d637f51f2a9d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.450336 Nov 21 17:16:19.508512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 176/344] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:19 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:19.563168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:19.565471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:19.580490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:19.581692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:19.583765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:19.585752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:19.952824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-01dfdb1b-e5ab-49e0-802e-081f05d07dab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.398180 Nov 21 17:16:19.954071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 169/345] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:19 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:20.079008 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:20.080206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:20.088252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.089088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.090130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.090811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.352755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:20.356531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:20.383613 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.384388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.385963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.386709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.505405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:20.526170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8b103d32-54c5-4e6d-a6ab-d839029aab5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.455612 Nov 21 17:16:20.531670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 177/346] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:20 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:20.548183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:20.549130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:20.557374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.558208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.559697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.560549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.961012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:20.971755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:20.972989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fcb81984-015e-48fa-b97b-4caf95e86cf9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.650373 Nov 21 17:16:20.974153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 170/347] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:20 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:20.984683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:20.985913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:20.986846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:20.987465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:20.988053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9c7b993e-372e-481b-a7be-f4f590524e8d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.444124 Nov 21 17:16:20.990681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 178/348] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:20 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:20.996335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.997155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:20.998186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:20.998897 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:21.114194 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-085b3745-7652-4449-8bb4-278e4406e238 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.137716 Nov 21 17:16:21.119174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 171/349] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:20 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:21.213823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-9cdbb149-c4c6-4a38-ab2b-a3a296192a9b req-e371fdcc-17c5-483a-a524-22e13d21c30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5be76d-6c47-465b-816d-0896fe78fa9e", "tag": "82742a0b-ed1e-442e-a80f-f5255be7a1d2"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:21.216172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:16:21.216172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:16:21.237526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9cdbb149-c4c6-4a38-ab2b-a3a296192a9b req-e371fdcc-17c5-483a-a524-22e13d21c30d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:21.237973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9cdbb149-c4c6-4a38-ab2b-a3a296192a9b req-e371fdcc-17c5-483a-a524-22e13d21c30d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:21.251889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-9cdbb149-c4c6-4a38-ab2b-a3a296192a9b req-e371fdcc-17c5-483a-a524-22e13d21c30d service nova] Creating event network-changed:82742a0b-ed1e-442e-a80f-f5255be7a1d2 for instance fe5be76d-6c47-465b-816d-0896fe78fa9e on hv-cinder-81869 Nov 21 17:16:21.257674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-9cdbb149-c4c6-4a38-ab2b-a3a296192a9b req-e371fdcc-17c5-483a-a524-22e13d21c30d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048588 Nov 21 17:16:21.258795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 179/350] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:16:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:21.562524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:21.565938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:21.591316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:21.593758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:21.595405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:21.596076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:21.939853 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:21.948171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f881421a-2fbb-4fd4-aff1-d6ec0ac4d742 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.394355 Nov 21 17:16:21.952900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 172/351] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:21 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:22.020260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:22.023584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.024140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:22.024784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.036035 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.040348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.040348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.041352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.068684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.069542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.071249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.074048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.414464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:22.426132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:22.428296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:22.430021 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b1cebe01-126e-4571-b64f-f0e0bccc7102 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.410618 Nov 21 17:16:22.430956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 173/352] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:22 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:22.436906 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:22.438252 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.444965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.445787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.446901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.447823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.529545 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3ef53691-5836-4e4c-bf91-3fe105fec723 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 14 microversion: 2.1 time: 0.096652 Nov 21 17:16:22.530736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 174/353] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:22 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:22.608309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:22.616819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c2a5f845-978f-4a19-8c22-764896978b3a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1501 microversion: 2.1 time: 0.613684 Nov 21 17:16:22.617739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 180/354] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:22 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1501 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:22.647966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6bba3ce-df32-4cea-b062-048922723a3e"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:22.651214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.665164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.666426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.668038 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.668873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.742090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] HTTP exception thrown: Cannot 'attach_volume' instance 7a5eddea-80da-4ad2-a69a-4150ee61891a while it is in vm_state rescued Nov 21 17:16:22.743073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Returning 409 to user: Cannot 'attach_volume' instance 7a5eddea-80da-4ad2-a69a-4150ee61891a while it is in vm_state rescued {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:16:22.744852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a098a65d-511b-4358-9576-ca099ae2c341 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104811 Nov 21 17:16:22.745854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 175/355] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:16:22 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 21 17:16:22.758921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:22.759514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.767248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.767701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.768555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.769022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.887299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aaa33f66-8e72-448e-87f5-6c4d1a53f8e7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action" status: 202 len: 0 microversion: 2.1 time: 0.132362 Nov 21 17:16:22.887944 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 181/356] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:22 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:16:22.901865 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:22.902164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:22.926741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.927193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.932955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:22.934023 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:22.984912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:22.990804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:23.022993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.028423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.030882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.031840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.477418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:23.495053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dd8e820e-b0e5-4d46-a7a2-12f42a77f595 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.595767 Nov 21 17:16:23.515059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 176/357] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:22 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:23.519948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:23.524559 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:23.535460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:23.537893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.542929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.545127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.546421 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.548307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6a11a6bf-b8e3-4e59-8897-8eab388ecb5e tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.578732 Nov 21 17:16:23.548922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 182/358] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:22 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:23.556453 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:23.561125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:23.572511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.573176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.574253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:23.574914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:23.715012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9cca4458-b86a-47d7-b76b-e17c75ec7faa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 8316 microversion: 2.1 time: 0.161886 Nov 21 17:16:23.716132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 183/359] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:23 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 8316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:23.781422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:23.796822 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:23.799628 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:23.801848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7eae4e3a-6101-4a87-ace2-ae78b0de1a71 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.285453 Nov 21 17:16:23.802895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 177/360] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:23 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:24.522695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:24.523417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:24.530943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.531391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.532177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.532613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.573452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:24.574179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:24.581000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.581543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.582462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.583007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.740720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:24.751267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f2ee3b00-8c2a-4569-8a9c-3c2956d3e336 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.232858 Nov 21 17:16:24.752039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 184/361] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:24 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:24.761242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:24.763252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:24.772178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:24.773213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.773666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.774519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.775634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.786819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-aa40b07d-8e9a-4843-9f84-c5f9a525dbee tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.216792 Nov 21 17:16:24.787873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 178/362] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:24 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:24.828975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:24.829636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:24.836130 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.836566 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.837348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:24.838336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:24.979169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:24.989875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:24.991484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:24.992680 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1e5d63f2-e4a5-467f-9412-75d485c9981d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.167751 Nov 21 17:16:24.993248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 179/363] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:24 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:25.779469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:25.780199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:25.789414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:25.790233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:25.791227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:25.791905 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:25.944168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:25.953825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9c20a622-f0a4-4f18-96a3-08f17f4b7f78 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.179020 Nov 21 17:16:25.954411 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 180/364] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:25 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:25.959060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:25.959689 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:25.966996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:25.967440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:25.968248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:25.968688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:26.120913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:26.129175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ee9f3d51-0711-44ab-a05b-8a9d9334fc53 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.173553 Nov 21 17:16:26.129849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 181/365] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:25 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:26.142089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:26.142089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:26.144856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:26.145415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:26.146438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:26.147153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:26.329347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:26.344387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:26.347475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:26.349674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5fbc4bf3-1bba-4868-89f1-76b703e65773 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.218229 Nov 21 17:16:26.350854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 182/366] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:26 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:26.973539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:26.974280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:26.981202 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:26.981654 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:26.982432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:26.982899 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:27.111716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:27.121121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0e35055c-71f7-4314-9860-a075ba7b01c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.151835 Nov 21 17:16:27.121697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 183/367] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:26 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:27.152945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:27.153543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:27.159501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:27.159936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:27.160696 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:27.161120 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:27.291327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:27.304596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4957d122-1d36-414f-ace1-2c96b2a85457 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.154908 Nov 21 17:16:27.305570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 184/368] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:27 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:27.380120 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:27.380869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:27.388809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:27.389257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:27.390039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:27.390471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:27.527984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:27.537305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:27.539020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:27.540251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-80ab888a-4405-4184-9d02-062a94137804 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.164437 Nov 21 17:16:27.541142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 185/369] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:27 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:27.628282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d1fcfcb0-ddc9-43d1-8229-01fedae78529 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 18155 microversion: 2.1 time: 2.874614 Nov 21 17:16:27.628931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 185/370] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:24 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 18155 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:28.139304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:28.139908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:28.145976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.146425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.147247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.147682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.289891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:28.309431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b22c476d-eaba-43fc-9dc1-cde23c9f5014 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.174145 Nov 21 17:16:28.310381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 186/371] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:28 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:28.330216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:28.330972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:28.338039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.338537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.339430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.339860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.488566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:28.496237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ec51e305-2f8c-4ec5-8e61-59fc68f40903 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.170378 Nov 21 17:16:28.497306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 186/372] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:28 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:28.574659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:28.575766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:28.592707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.593519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.595046 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.595832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.640778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:28.641918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:28.648840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.649662 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.651364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:28.651877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:28.800985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:28.810377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:28.811987 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:28.813217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ad4b65ee-b646-4559-961c-a06a537150e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.246913 Nov 21 17:16:28.813780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 187/373] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:28 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:29.328353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:29.329314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:29.335443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.335924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.336713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.337150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.481569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:29.489778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-46b255f4-6a73-4738-bcbf-f49e8398d383 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.165343 Nov 21 17:16:29.490368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 188/374] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:29 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:29.521998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:29.522714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:29.529527 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.530091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.531042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.531539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.665493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:29.673587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9adea11-5fad-471a-9e47-cd0edce46710 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.155412 Nov 21 17:16:29.674174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 189/375] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:29 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:29.840543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:29.841433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:29.847926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.848375 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.849157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:29.849593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:29.983109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:29.993265 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:29.995081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:29.996254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5330fea5-2cc9-4f99-800c-cd2c4091868d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.160100 Nov 21 17:16:29.996821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 190/376] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:29 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:30.508142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:30.508830 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:30.515961 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:30.516468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:30.517312 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:30.517801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:30.652903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:30.660573 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fdc2f523-4e1e-4c08-afee-b7cf6ace7794 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.156124 Nov 21 17:16:30.661238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 191/377] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:30 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:30.691615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:30.692383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:30.700019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:30.700472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:30.701268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:30.701707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:30.849143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:30.859371 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-43be8b95-22cb-4919-b0b8-07596e314b00 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.171643 Nov 21 17:16:30.859964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 192/378] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:30 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:31.013396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-42c3bd25-6e55-4856-8840-75d8157d9b4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 23804 microversion: 2.1 time: 2.376748 Nov 21 17:16:31.014320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 187/379] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:28 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 23804 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:31.016079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:31.016732 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:31.022989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.023443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:31.024222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.024658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:31.173892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:31.190509 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:31.193837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:31.196157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c590a4b5-0ac6-461e-99fe-bfdf13b4457f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.183517 Nov 21 17:16:31.212443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 193/380] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:31 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:31.678607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:31.679237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:31.686758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.687203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:31.687989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.688412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:31.851486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:31.859935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e1792488-d24f-46d6-b833-e46023799e8a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.185401 Nov 21 17:16:31.860501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 188/381] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:31 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:31.877176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:31.877782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:31.883811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.884686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:31.885465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:31.885891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.026666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:32.028805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:32.035277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.035766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:32.035971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.036569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.037008 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.049844 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f93a3301-4b22-49bc-a2ee-a2df774be000 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.175820 Nov 21 17:16:32.050944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 194/382] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:31 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:32.228001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:32.228698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:32.235532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.235984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.236780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.237215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.386657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:32.395050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:32.396563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:32.397757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3cfa5331-3c2b-4762-aa18-46006b4ac705 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.174075 Nov 21 17:16:32.398318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 195/383] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:32 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:32.877773 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:32.878406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:32.885225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.885798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:32.886595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:32.887069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:33.026401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:33.034404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ea506ba-9a41-4eea-83fc-ac4be11a5b23 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.160342 Nov 21 17:16:33.035089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 196/384] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:32 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:33.077851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:33.078743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:33.087172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:33.088878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:33.089682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:33.090122 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:33.229990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:33.237736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-100937cc-7aae-47b2-8802-ed57e3ff229d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.163568 Nov 21 17:16:33.238323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 197/385] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:33 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:33.419298 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:33.420513 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:33.427741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:33.428159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:33.429226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:33.429852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:33.567215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:33.576595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:33.579805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:33.582361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1f518552-7afa-4598-914a-91566b4e8ee8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.168651 Nov 21 17:16:33.583601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 198/386] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:33 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:34.053480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:34.054184 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:34.060780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.061240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.062065 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.062506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.217562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:34.226321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f22b277-983d-441f-92ff-ce8bd7f7c223 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1509 microversion: 2.1 time: 0.176965 Nov 21 17:16:34.226950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 199/387] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:34 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:34.255643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:34.256358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:34.263997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.264452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.265257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.265700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.426612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:34.441563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-460303e7-c873-41a3-9c41-dc76ac7c0cb9 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.189258 Nov 21 17:16:34.442700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 200/388] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:34 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:34.601658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:34.602379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:34.609747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.610245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.611134 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:34.611680 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:34.770096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:34.779064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:34.780605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:34.781807 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d0997896-96b0-4243-8208-6ce8492e8a9f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.184261 Nov 21 17:16:34.782391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 201/389] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:34 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:35.037430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-afafea5d-cef7-4cee-84a5-3aebcc81a041 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 27307 microversion: 2.1 time: 3.014495 Nov 21 17:16:35.038588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 189/390] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:32 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 27307 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:35.246232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:35.246900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:35.253210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.253653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:35.254434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.254896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:35.402585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:35.416015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6705ca8c-e54d-4a31-96e1-8b84ced8b35b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1515 microversion: 2.1 time: 0.173796 Nov 21 17:16:35.417105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 202/391] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:35 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:35.462186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:35.463743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:35.473419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.474086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:35.475075 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.475638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:35.709112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:35.728341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0669bee0-4336-4dd2-ade8-5eed0a21781d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.270198 Nov 21 17:16:35.728627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 190/392] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:35 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:35.824932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:35.827768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:35.843295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.844929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:35.847584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:35.848865 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.011190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-9dcee235-5e34-4e2e-b099-50ba88e98122 req-518e46f6-122c-48b6-b1e7-ecec9c8d4142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5be76d-6c47-465b-816d-0896fe78fa9e", "name": "network-vif-plugged", "status": "completed", "tag": "82742a0b-ed1e-442e-a80f-f5255be7a1d2"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:36.015128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:16:36.015128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:16:36.046604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9dcee235-5e34-4e2e-b099-50ba88e98122 req-518e46f6-122c-48b6-b1e7-ecec9c8d4142 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:36.050421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9dcee235-5e34-4e2e-b099-50ba88e98122 req-518e46f6-122c-48b6-b1e7-ecec9c8d4142 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.078117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-9dcee235-5e34-4e2e-b099-50ba88e98122 req-518e46f6-122c-48b6-b1e7-ecec9c8d4142 service nova] Creating event network-vif-plugged:82742a0b-ed1e-442e-a80f-f5255be7a1d2 for instance fe5be76d-6c47-465b-816d-0896fe78fa9e on hv-cinder-81869 Nov 21 17:16:36.086859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-9dcee235-5e34-4e2e-b099-50ba88e98122 req-518e46f6-122c-48b6-b1e7-ecec9c8d4142 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086316 Nov 21 17:16:36.088042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 191/393] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:36.107470 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:36.108575 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:36.119346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:36.119754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.120587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:36.121020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.156160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:36.172654 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:36.177684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:36.180074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-69e05fa5-46e8-4fcd-af69-dcc685064cfb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.381152 Nov 21 17:16:36.181152 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 203/394] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:35 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:36.259117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e042918f-f950-4338-b113-a473eef975e3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 27546 microversion: 2.1 time: 0.163940 Nov 21 17:16:36.260696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 192/395] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:36 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 27546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:36.747095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:36.747984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:36.754659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:36.755356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.756272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:36.756929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:36.911831 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:36.921594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c045a038-c816-41a3-bd7f-f60fc37a164c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.178972 Nov 21 17:16:36.922601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 204/396] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:36 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:37.049711 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:37.050585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:37.057510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.057962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.058981 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.059420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.204614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:37.206012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:37.211137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:37.217289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.218059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.219951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.220506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-adc25ed3-f017-450f-8eb8-d2ed7b4f9d8c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1515 microversion: 2.1 time: 0.174825 Nov 21 17:16:37.220676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.232419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 193/397] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:37 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:37.237578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19f9b963-1393-4cba-a11a-389283220291"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:37.238956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:37.247334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.247776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.248771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.249437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.413170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:37.425518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:37.427549 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:37.429041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ca7e2f00-ba3a-4939-b07c-6ab39e01e317 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.233091 Nov 21 17:16:37.429787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 205/398] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:37 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:37.438719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:37.440723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:37.451456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.451996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:37.452955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:37.453833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:39.848395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b2e410d8-90a6-426e-a72a-f5a1d807b0f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 27770 microversion: 2.1 time: 2.416089 Nov 21 17:16:39.851296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 206/399] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:37 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 27770 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:39.861975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:39.863224 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:39.875064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:39.876275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:39.877689 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:39.878454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:39.977280 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e3eaf334-e1f3-4793-be58-1d80c3fad376 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.743421 Nov 21 17:16:39.979019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 194/400] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:16:37 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments => generated 194 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:16:39.986997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:39.988805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:40.004419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:40.005600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:40.007547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:40.008715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:40.104592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:40.119068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0747ad4c-3eee-4a5f-b3ed-6a4260e9c7c5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.264948 Nov 21 17:16:40.120158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 207/401] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:39 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:40.205411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:40.216725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:40.218243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:40.219484 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-67ebc485-58b7-40cd-ae0a-738e87dfa841 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1745 microversion: 2.20 time: 0.239200 Nov 21 17:16:40.230912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 195/402] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:39 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:40.865354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:40.867016 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:40.882695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:40.884107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:40.886928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:40.888340 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:40.999972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-14140e2f-5425-44e3-8081-c6efe9e12f95 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28130 microversion: 2.1 time: 0.139819 Nov 21 17:16:41.000984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 208/403] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:40 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28130 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:41.147875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:41.149012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:41.162368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:41.163227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:41.164671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:41.175636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:41.251942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:41.253582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:41.268529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:41.269989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:41.272686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:41.274976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:41.444553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:41.458933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-44733656-72d5-42b7-b9d6-7c982be70af7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1317 microversion: 2.1 time: 0.315185 Nov 21 17:16:41.459736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 196/404] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:41 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:41.553746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:41.564989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:41.567840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:41.569910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4c442f30-4540-4b56-8a38-394b520b7754 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1745 microversion: 2.20 time: 0.332027 Nov 21 17:16:41.570582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 209/405] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:41 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1745 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:42.014311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:42.015432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:42.022456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.023125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.024010 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.025029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.113414 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-06f8131b-2759-4fb8-b053-511b14e19252 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28130 microversion: 2.1 time: 0.103216 Nov 21 17:16:42.114116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 197/406] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:42 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28130 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:42.490469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:42.491716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:42.500166 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.500564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.501675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.502305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.595207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:42.596022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:42.603144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.603955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.604822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:42.605281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:42.711272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:42.723787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a2d66a1c-b78e-4615-b99d-749c02601b1a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1508 microversion: 2.1 time: 0.237566 Nov 21 17:16:42.724822 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 210/407] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:42 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:42.786312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:42.801105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:42.803956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:42.806454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-77e92def-a045-40fe-a514-afc001fd9fbe tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1745 microversion: 2.20 time: 0.214963 Nov 21 17:16:42.807576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 198/408] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:42 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:43.130674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:43.132735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:43.147685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:43.149113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:43.151141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:43.152512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:43.255646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-80ce5fb5-a797-4502-b871-525da36e1b38 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28130 microversion: 2.1 time: 0.131878 Nov 21 17:16:43.261474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 211/409] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:43 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28130 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:43.835502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:43.836565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:43.847715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:43.848680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:43.849893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:43.850591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:44.081552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:44.095460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:44.099096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:44.101006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-64ee01ba-8598-494b-bde9-49f079c846e8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.273573 Nov 21 17:16:44.101934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 199/410] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:43 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:44.276430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:44.279239 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:44.300996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:44.302098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:44.302890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "019b496e-199a-4bfd-a871-16c85d2a42c3"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:44.303981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:44.304801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:44.305474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:44.317605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:44.318307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:44.319680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:44.320768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:44.444240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2c7aa30e-db94-4904-b82d-cce024e27e1f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28382 microversion: 2.1 time: 0.176730 Nov 21 17:16:44.447058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 212/411] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:44 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28382 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:44.908018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aee32817-55f1-4c8c-8f57-936712615d18 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "POST /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611352 Nov 21 17:16:44.910574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 200/412] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:16:44 2021] POST /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:16:45.166592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:45.167618 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:45.185419 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:45.186468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:45.188662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:45.189618 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:45.459358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:45.460455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:45.475315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:45.480741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:45.481866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:45.482602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:45.530959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:45.552256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:45.554139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:45.555938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ad59f1a8-b0ca-4ec2-a0ab-3b170d0ccf61 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.428742 Nov 21 17:16:45.557637 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 213/413] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:45 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:45.617411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5d72d5fd-16e4-4ae5-9e41-66e41f36387f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28420 microversion: 2.1 time: 0.162494 Nov 21 17:16:45.619185 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 201/414] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:45 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28420 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:46.060067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-5ae04020-e796-4690-9c0e-691ab14ae546 req-39c15dce-87ce-4202-aa7d-8a4d5b3580ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "name": "network-vif-plugged", "status": "completed", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:46.063967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:16:46.063967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:16:46.079474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-5ae04020-e796-4690-9c0e-691ab14ae546 req-39c15dce-87ce-4202-aa7d-8a4d5b3580ed service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:46.080701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-5ae04020-e796-4690-9c0e-691ab14ae546 req-39c15dce-87ce-4202-aa7d-8a4d5b3580ed service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:46.104110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-5ae04020-e796-4690-9c0e-691ab14ae546 req-39c15dce-87ce-4202-aa7d-8a4d5b3580ed service nova] Creating event network-vif-plugged:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:16:46.113539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-5ae04020-e796-4690-9c0e-691ab14ae546 req-39c15dce-87ce-4202-aa7d-8a4d5b3580ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063034 Nov 21 17:16:46.117445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 214/415] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:16:46.602923 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:46.605918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:46.640121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:46.640121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:46.645627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:46.646561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:46.646799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:46.647047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:46.648035 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:46.648214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:46.648454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:46.648869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:46.770321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-255e60f3-f3e2-44be-b623-943fbdbd17b5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28588 microversion: 2.1 time: 0.140117 Nov 21 17:16:46.771111 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 215/416] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:46 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28588 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:47.517932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:47.546506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:47.553486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:47.557108 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dc2f9d8d-181f-4886-8b38-d9ffa03f3424 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.967001 Nov 21 17:16:47.559209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 202/417] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:46 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:47.789304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:47.793303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:47.802933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:47.803857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:47.805356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:47.806612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:47.911411 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f73e5be-d78d-42b4-9e2d-53f3056afd7f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28588 microversion: 2.1 time: 0.127482 Nov 21 17:16:47.913672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 216/418] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:47 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28588 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:48.205067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:48.207269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:48.215638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.216493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.217565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.218257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.253707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lazy-loading 'flavor' on Instance uuid 7a5eddea-80da-4ad2-a69a-4150ee61891a {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:16:48.588413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:48.594128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:48.629522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.632763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.638465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.658699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.718313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d5e7f929-d979-41bc-9e02-99776abaa4f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action" status: 200 len: 32 microversion: 2.1 time: 0.513559 Nov 21 17:16:48.732183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 203/419] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:48 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:48.764261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:48.767791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:48.786764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.788933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.792239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:48.794150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:48.944727 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:48.957971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:48.964438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:48.968112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8805b776-74a5-4a3d-9f4a-342161a346c5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.392617 Nov 21 17:16:48.978725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 217/420] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:48 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:48.997417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:48.999189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:49.063728 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:49.068818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:49.071268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:49.072730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:49.166132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:49.184220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8c0870ab-03c3-438f-b0f8-f7062337a5f2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.449242 Nov 21 17:16:49.186238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 204/421] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:48 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:49.208723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-64528045-3233-49f6-a5d2-876cda3634c0 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28588 microversion: 2.1 time: 0.227538 Nov 21 17:16:49.210900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 218/422] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:48 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28588 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:50.020578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:50.023049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:50.030344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.031401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.033967 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.035045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.226398 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:50.239883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:50.257447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.262747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.266955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.268153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.305221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:50.342191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:50.349354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:50.362861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c62f88e0-68df-4e49-8fed-8abf77ca265a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.358319 Nov 21 17:16:50.364793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 205/423] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:50 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:50.374813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:50.377121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:50.390513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.391253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.392660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:50.393450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:50.522512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3ebfd570-37a5-4ff0-9a47-9e32d2f1361c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28588 microversion: 2.1 time: 0.155171 Nov 21 17:16:50.529616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 206/424] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:50 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28588 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:50.642514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:50.669820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-129876fe-a4aa-4904-b04c-5f3b3ce0b63c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.458389 Nov 21 17:16:50.672370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 219/425] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:50 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:51.398956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:51.400713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:51.417308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.417787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:51.418660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.419124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:51.538116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:51.539286 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:51.556861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.558168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:51.560801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.561998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:51.599809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:51.610293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:51.612217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:51.613520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-95e0d41a-09db-4a1d-8d0b-98119a7a8fcf tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.218717 Nov 21 17:16:51.626671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 207/426] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:51 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:51.688546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-95204152-69b5-4fa1-80bf-109fb5e953c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 28588 microversion: 2.1 time: 0.153897 Nov 21 17:16:51.690928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 220/427] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:51 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 28588 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:51.703441 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:51.705255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:51.722609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.723348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:51.724564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:51.725306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:52.027100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:52.042820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-df1684cb-cda9-4f53-b310-77caa40ad8c5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.343847 Nov 21 17:16:52.044805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 208/428] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:51 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:52.654541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:52.663955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:52.688914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:52.689731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:52.691404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:52.692143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:52.706771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:52.708826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:52.741044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:52.743928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:52.745744 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:52.746753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:52.873521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c4de66ac-b7b1-4d21-a002-80960411058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 29604 microversion: 2.1 time: 0.172540 Nov 21 17:16:52.874840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 209/429] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:52 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 29604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:53.003115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:53.013408 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:53.020125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:53.021846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9dcc26ff-2647-477f-b9bc-2bee9972cdd3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.376649 Nov 21 17:16:53.023334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 221/430] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:52 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:53.066012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:53.067054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:53.075710 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:53.076236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:53.077271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:53.077913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:53.355329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:53.364466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5761bc3b-b5d5-4107-ab3f-107f4c903545 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.303518 Nov 21 17:16:53.365372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 210/431] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:53 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:53.889188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:53.892150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:53.903581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:53.904489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:53.905697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:53.906406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.022112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-17ffee2a-ce44-44b7-a839-2b0d56e20d75 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 30595 microversion: 2.1 time: 0.138362 Nov 21 17:16:54.028236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 222/432] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:53 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 30595 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:54.049474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:54.050387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:54.073936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.076000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.077919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.079596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.400151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:54.402855 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:54.421088 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.422880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.425147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.427274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.434562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:54.456212 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:54.459065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:54.460726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9d3acd60-1e29-4b62-aa40-1fe1b3a21239 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.415970 Nov 21 17:16:54.473733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 211/433] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:54 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:54.800037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:54.803242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:54.811377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.812305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.813329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:54.814010 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:54.874502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:54.891002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-722c020a-0444-4c58-a071-f7b4540cd122 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.501131 Nov 21 17:16:54.919341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 223/434] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:54 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:55.032663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lazy-loading 'services' on Instance uuid fe5be76d-6c47-465b-816d-0896fe78fa9e {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:16:55.038595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:55.041005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:55.050889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.051342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.052391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.052876 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.149737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8bf31574-b66a-4d28-af8d-4a5eb6fb9967 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments/019b496e-199a-4bfd-a871-16c85d2a42c3" status: 202 len: 0 microversion: 2.1 time: 0.354319 Nov 21 17:16:55.159222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 212/435] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:16:54 2021] DELETE /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments/019b496e-199a-4bfd-a871-16c85d2a42c3 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:16:55.187338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5df4b3f2-994e-43c1-bff7-c590dc23ab49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 31700 microversion: 2.1 time: 0.153816 Nov 21 17:16:55.188513 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 224/436] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:55 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 31700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:55.200572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:55.202452 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:55.228999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.229561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.244109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.245829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.320618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-152a1c30-3ba0-49e2-9e5f-5385862091e4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146744 Nov 21 17:16:55.322469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 213/437] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:16:55 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:16:55.497946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:55.498993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:55.509087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.509948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.511288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.511821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.761512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:55.771524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:55.773164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:55.774946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d7c62352-ba70-4d91-a314-65e16bcb0a0b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.297472 Nov 21 17:16:55.775857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 225/438] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:55 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:55.930177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:55.932782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:55.973709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.974833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:55.976600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:55.978204 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.209349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:56.211083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:56.238350 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.239392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.241469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.242655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.391847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:56.402804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-db5854fb-e3dc-4cd9-b388-c54abf084055 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.478748 Nov 21 17:16:56.403387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 214/439] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:55 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:56.424237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fac72cc1-f7b3-4ab5-bb39-55ee10841f10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 32221 microversion: 2.1 time: 0.221935 Nov 21 17:16:56.425387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 226/440] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:56 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 32221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:56.426006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:56.427085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:56.436643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.437382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.438595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.439115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.493094 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d1c21c9a-776d-4a67-bc17-dac30c88ba5c tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088047 Nov 21 17:16:56.500803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 215/441] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:16:56 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:16:56.800089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:56.801361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:56.810073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.811384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.811839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:56.812151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:56.988240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:56.999068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:57.000745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:57.002058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2538f1aa-c7d0-4749-ba6c-0c81a1832639 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.207494 Nov 21 17:16:57.002610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 227/442] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:56 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:57.383065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1540682185", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "194e21e2-e235-4f36-bc81-802507f8b3c9"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:57.431238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:57.433692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:57.447249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:57.448401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:57.449956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:57.450962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:57.473132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] validate_networks() for [('194e21e2-e235-4f36-bc81-802507f8b3c9', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:16:57.826897 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:57.841621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e2d2aa3b-4dc2-406c-8d05-0bd6d4ca4bd8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.418148 Nov 21 17:16:57.842473 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 228/443] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:57 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:57.858719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:57.859948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:57.867618 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:57.868586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:57.869374 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:57.869796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:57.987561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dc621b58-4cc4-457c-8897-4be0a91ba274 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 33020 microversion: 2.1 time: 0.131684 Nov 21 17:16:57.989258 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 229/444] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:57 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 33020 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:16:58.000479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:58.002661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:58.016418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.017209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.018601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.019404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.087071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6ccc4748-368d-4314-a1e5-52d3bfd79273 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095759 Nov 21 17:16:58.094837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 230/445] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:16:57 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:16:58.094837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:58.094837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:58.126541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.127039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.127911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.132288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.295951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:16:58.297131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:16:58.298230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:16:58.299285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:16:58.300569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:16:58.344637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.345487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.347139 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.347984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.389965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Getting quotas for project dead7671a99e42d5b3d44db11c894350. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:16:58.410494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Getting quotas for user 5401d84b70a24aa5a0011c5160fcac33 and project dead7671a99e42d5b3d44db11c894350. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:16:58.434843 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:58.441554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:16:58.444708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:16:58.451971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:58.454212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:58.455742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-817b65e4-e608-4b27-b5ef-c212012bb236 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1740 microversion: 2.20 time: 0.366878 Nov 21 17:16:58.456858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 231/446] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:58 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:16:58.513019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-41607033-7ec0-4752-8a8f-fafcb9207ab6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133771 Nov 21 17:16:58.514766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 216/447] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:16:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:16:58.526952 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-77355875-d259-4464-ad78-f3b8f9df841f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:58.528789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-77355875-d259-4464-ad78-f3b8f9df841f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:58.600881 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-77355875-d259-4464-ad78-f3b8f9df841f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:58.613885 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-77355875-d259-4464-ad78-f3b8f9df841f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1214 microversion: 2.1 time: 0.092311 Nov 21 17:16:58.614990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 232/448] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:58 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:58.864188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:58.865326 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:58.877368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.878553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:58.879652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:58.880452 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.002202 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:16:59.003575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:59.014837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.015963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.017411 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.018361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.053458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.064965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-21c5127c-d482-4277-b42d-6cd4ecde0377 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.206370 Nov 21 17:16:59.065757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 217/449] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:58 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:16:59.162747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-73133fa3-abdf-4a58-acda-d7b6402f3a61 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 33551 microversion: 2.1 time: 0.165226 Nov 21 17:16:59.163420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 233/450] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:16:58 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 33551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:16:59.456919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:59.458183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:59.466156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.467122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.468425 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.469125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.478307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:59.479940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:59.487702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.488329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.489235 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.489883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.521328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:16:59.610595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a95027fd-ae81-4bc1-8e7f-a8dd66c371c6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 204 len: 0 microversion: 2.1 time: 0.158207 Nov 21 17:16:59.611538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 218/451] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:16:59 2021] DELETE /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:16:59.622510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:59.624243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:59.631576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.632019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.632823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.633306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.664129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.674651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.676479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.677701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-aa2773cb-d1cf-4fb5-8beb-e8d85e368548 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1722 microversion: 2.20 time: 0.204123 Nov 21 17:16:59.686769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 234/452] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:16:59 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:16:59.696854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:16:59.698579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:16:59.711653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.712959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.714745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:16:59.715898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:16:59.837352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.854335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-deb0268f-9bfa-4cbd-a7ff-dcd7cb420d96 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1266 microversion: 2.1 time: 0.163257 Nov 21 17:16:59.862956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 235/453] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:59 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:16:59.895141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:16:59.905748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-16072c8f-6537-436f-8689-87a0dd073222 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1514 microversion: 2.1 time: 0.289838 Nov 21 17:16:59.907009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 219/454] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:16:59 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:00.089896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:00.091050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:00.105108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.106259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.108577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.109383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.185610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:00.188992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:00.201292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.202089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.203304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.204344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.339816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-45f1542d-95b4-4701-9670-cb25f1768416 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 34130 microversion: 2.1 time: 0.165203 Nov 21 17:17:00.342646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 220/455] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:00 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 34130 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:17:00.505744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:00.516919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-55bacfbd-dfc0-4d96-88de-abb818bde156 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.435235 Nov 21 17:17:00.517844 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 236/456] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:00 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:00.702717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:00.704282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:00.725456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.726560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.728636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.729395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.873344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:00.874123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:00.880690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.881242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.882126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:00.882678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:00.994805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.015441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b7eabc0a-25cd-4277-9e9c-dcd9f9126f31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1272 microversion: 2.1 time: 0.145381 Nov 21 17:17:01.016256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 237/457] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:00 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:01.022763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:01.023782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:01.032910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.033669 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.034989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.035727 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.037922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.053346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.057490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.059914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cab61861-4a91-4222-a4de-b579a630ce36 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1722 microversion: 2.20 time: 0.364781 Nov 21 17:17:01.061025 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 221/458] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:00 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:01.312084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.324903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e0bcf9ea-cbfe-4d1e-806f-532e0d1d1f20 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1514 microversion: 2.1 time: 0.307014 Nov 21 17:17:01.325907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 238/459] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:01 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:01.359012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:01.360015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:01.367028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.367651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.369404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.370018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.465214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bf240550-b986-4589-959a-5f7b101669ab tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 34857 microversion: 2.1 time: 0.109981 Nov 21 17:17:01.465920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 222/460] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:01 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 34857 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:17:01.546592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:01.547750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:01.559233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.560216 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.561850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:01.562706 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:01.839333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:01.848320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e505625f-866f-4133-ad9e-90c3bbaea9c1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.309604 Nov 21 17:17:01.848919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 239/461] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:01 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:02.044538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:02.045758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:02.056919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.057818 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.059603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.060161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.085671 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:02.086907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:02.101085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.105495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.106756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.107561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.512308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:02.523245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f5eba584-6445-4d8e-a866-1dab4164c32d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.485993 Nov 21 17:17:02.538679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 223/462] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:02 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:02.545385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:02.546059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:02.564195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.564639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.565660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.566297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.640235 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:02.655647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:02.657113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:02.658800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-81afd99c-4fdd-4627-8d77-c79635737dd5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1722 microversion: 2.20 time: 0.582230 Nov 21 17:17:02.671653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 240/463] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:02 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1722 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:02.677359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:02.678726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:02.687685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.688489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.689535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.690170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.746366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:02.767110 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1a97403d-7485-4eae-b3ea-8ebe14c195ad tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 200 len: 1472 microversion: 2.1 time: 0.240845 Nov 21 17:17:02.769583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 224/464] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:02 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:02.780925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-64a589b1-7c2b-49b0-b1d3-e7423dcd5bb8 req-9380e432-0601-43af-8a6e-e3da7bfa35f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5be76d-6c47-465b-816d-0896fe78fa9e", "name": "network-vif-deleted", "tag": "82742a0b-ed1e-442e-a80f-f5255be7a1d2"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:02.784636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:02.784636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:02.793768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-15f82ab6-4aa8-455b-8795-e171424d0a8e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 35673 microversion: 2.1 time: 0.119734 Nov 21 17:17:02.795276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 241/465] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:02 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 35673 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:17:02.803470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-9879b541-ff44-4928-ac53-28f00b68c5ae req-5685ffba-cecf-47a3-b44f-44eea300b0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e194a0-92ef-4d76-bee9-31816839b199", "tag": "cb6c5893-6210-499d-a5ea-685c2c4a3c95"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:02.805588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:02.805588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:02.808808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-64a589b1-7c2b-49b0-b1d3-e7423dcd5bb8 req-9380e432-0601-43af-8a6e-e3da7bfa35f1 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.809961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-64a589b1-7c2b-49b0-b1d3-e7423dcd5bb8 req-9380e432-0601-43af-8a6e-e3da7bfa35f1 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.816832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-9879b541-ff44-4928-ac53-28f00b68c5ae req-5685ffba-cecf-47a3-b44f-44eea300b0f8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.817667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-9879b541-ff44-4928-ac53-28f00b68c5ae req-5685ffba-cecf-47a3-b44f-44eea300b0f8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.837616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-64a589b1-7c2b-49b0-b1d3-e7423dcd5bb8 req-9380e432-0601-43af-8a6e-e3da7bfa35f1 service nova] Creating event network-vif-deleted:82742a0b-ed1e-442e-a80f-f5255be7a1d2 for instance fe5be76d-6c47-465b-816d-0896fe78fa9e on hv-cinder-81869 Nov 21 17:17:02.848912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-64a589b1-7c2b-49b0-b1d3-e7423dcd5bb8 req-9380e432-0601-43af-8a6e-e3da7bfa35f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075561 Nov 21 17:17:02.850360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 225/466] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:02.854393 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-9879b541-ff44-4928-ac53-28f00b68c5ae req-5685ffba-cecf-47a3-b44f-44eea300b0f8 service nova] Creating event network-changed:cb6c5893-6210-499d-a5ea-685c2c4a3c95 for instance 29e194a0-92ef-4d76-bee9-31816839b199 on hv-cinder-81869 Nov 21 17:17:02.868781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-9879b541-ff44-4928-ac53-28f00b68c5ae req-5685ffba-cecf-47a3-b44f-44eea300b0f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071401 Nov 21 17:17:02.869458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 242/467] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:02.871296 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:02.872349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:02.890392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.890758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:02.894191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:02.896793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.186740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:03.194956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7baa9e65-2a5d-42a6-9116-378a32bf5b7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.330864 Nov 21 17:17:03.195535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 226/468] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:02 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:03.553072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:03.553790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:03.560760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.561201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.561969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.562522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.683632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:03.685549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:03.697500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.698290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.699887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.700687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.867173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:03.882870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b42eafb7-12fb-4df3-81ca-cd0dd1094eb2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.333212 Nov 21 17:17:03.884450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 243/469] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:03 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:03.910468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:03.911864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: fe5be76d-6c47-465b-816d-0896fe78fa9e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:03.924664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.925552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.927106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.928018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.948427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Instance fe5be76d-6c47-465b-816d-0896fe78fa9e could not be found. Nov 21 17:17:03.949167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 404 to user: Instance fe5be76d-6c47-465b-816d-0896fe78fa9e could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:03.950244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c033a094-6e56-4af6-a8eb-0870fbc873d4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e" status: 404 len: 111 microversion: 2.1 time: 0.064151 Nov 21 17:17:03.951701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 244/470] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:03 2021] GET /compute/v2.1/servers/fe5be76d-6c47-465b-816d-0896fe78fa9e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:03.956131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:03.963788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:03.984537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.985708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:03.987494 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:03.988331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.041840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.055584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.057251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.058447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e0f0b2f0-d839-48af-a9fc-8345fafd574d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1665 microversion: 2.20 time: 0.383033 Nov 21 17:17:04.068622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 227/471] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:03 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1665 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:04.084420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-13b758a0-e676-4005-b158-6811e687f9b2 req-be43c634-7ad1-4762-86b1-808565f380c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "name": "network-vif-unplugged", "status": "completed", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:04.087722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:04.087722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:04.094966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-13b758a0-e676-4005-b158-6811e687f9b2 req-be43c634-7ad1-4762-86b1-808565f380c5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.095474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-13b758a0-e676-4005-b158-6811e687f9b2 req-be43c634-7ad1-4762-86b1-808565f380c5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.107792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.compute.server_external_events [req-13b758a0-e676-4005-b158-6811e687f9b2 req-be43c634-7ad1-4762-86b1-808565f380c5 service nova] Unable to find a host for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22. Dropping event network-vif-unplugged {{(pid=115853) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 21 17:17:04.108759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-13b758a0-e676-4005-b158-6811e687f9b2 req-be43c634-7ad1-4762-86b1-808565f380c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033489 Nov 21 17:17:04.109418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 228/472] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:04 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 21 17:17:04.119966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-81646178-fcdf-42a3-a40a-b96a427b256c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 36627 microversion: 2.1 time: 0.166967 Nov 21 17:17:04.120116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd6c5aa-9b27-4fcc-8d3b-6af09dac1fb6"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:04.121362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:04.128736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 245/473] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:03 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 36627 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:17:04.132488 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.132929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.134133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.134286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.215393 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:04.216123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:04.224984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.225482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.226432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.227481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.540935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.548775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-36f61188-6c01-42a3-b8f2-5e4af68aaee4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.433502 Nov 21 17:17:04.549592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 229/474] 10.222.0.52 () {62 vars in 1363 bytes} [Sun Nov 21 17:17:04 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments => generated 188 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:17:04.550575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f7f24a33-ab41-4446-a6d8-938f796189cc tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.340224 Nov 21 17:17:04.551179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 246/475] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:04 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:04.685444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:04.686003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:04.693320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.693777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.694554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.695039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.794955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-85e0494e-c70f-460e-9990-803f68eca454 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action" status: 202 len: 0 microversion: 2.20 time: 0.113611 Nov 21 17:17:04.795875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 230/476] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:17:04 2021] POST /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:04.803931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:04.804535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:04.810723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.811432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.812212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.812640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.917196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:04.917810 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:04.925059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.925507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.926283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:04.926739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:04.954903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.966007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.967716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:04.969115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-115bfd78-d2ba-4fbf-984a-0ff93fefd1e7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1751 microversion: 2.20 time: 0.168920 Nov 21 17:17:04.969741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 247/477] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:04 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:05.088747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:05.096353 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-eb217d43-8109-484a-95f6-c0f261bc34f2 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.182865 Nov 21 17:17:05.097139 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 231/478] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:04 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:05.135307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:05.136599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:05.145831 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.146510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.147505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.148135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.172052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:05.172548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:05.182410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.182971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.183908 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.184351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.218262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:05.266936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cb0fb7f3-8016-4a05-9a98-1b419e5ef1ca tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 37770 microversion: 2.1 time: 0.134605 Nov 21 17:17:05.268142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 248/479] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:05 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 37770 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:17:05.319023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4c568d98-518f-4c2f-b0c9-9f513e93430a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 204 len: 0 microversion: 2.1 time: 0.149999 Nov 21 17:17:05.319720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 232/480] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:05 2021] DELETE /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 17:17:05.332165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:05.337431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:05.345459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.345850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.346782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.347560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.499470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:05.507014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7d50b2bd-c25d-4d8c-9c76-ee765df6d61d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1514 microversion: 2.1 time: 0.181192 Nov 21 17:17:05.507615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 249/481] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:05 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:05.575070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:05.575771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:05.583288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.583731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.584598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.585115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.729120 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:05.742019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d37f141c-dc2a-472f-99ee-2041fb912505 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.170719 Nov 21 17:17:05.742795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 233/482] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:05 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:05.987686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:05.988386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:05.994289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.994761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:05.995548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:05.995990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.115676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:06.116636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:06.125554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.125996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.127045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.128040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.147412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:06.160299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:06.162299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:06.163923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-90e26de5-8d18-4166-adc2-bb597126e932 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1753 microversion: 2.20 time: 0.179950 Nov 21 17:17:06.165725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 250/483] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:05 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:06.284540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:06.285992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:06.286161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:06.297157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.297973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.299426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.300176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.300392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b81c78e4-957b-4f7f-9129-e64b20bdac2f tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.189611 Nov 21 17:17:06.301288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 234/484] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:06 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:06.413881 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-456189cb-daac-428f-8a9a-7c597cda80bd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 38063 microversion: 2.1 time: 0.135516 Nov 21 17:17:06.418681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 251/485] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:06 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 38063 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:17:06.530254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:06.531600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:06.541536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.541997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.542872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.543321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.762313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:06.763660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:06.773360 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.774233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.775193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:06.775768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:06.911276 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:06.924036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2aa88d08-31df-4a91-904e-6aeb50e8d72a tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1514 microversion: 2.1 time: 0.401299 Nov 21 17:17:06.924885 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 235/486] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:06 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:07.066430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:07.076736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-30d2cefc-bee8-4c24-97f3-2a004f8fa42a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.319672 Nov 21 17:17:07.077327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 252/487] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:06 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:07.184836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:07.185442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:07.193119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.193561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.194339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.194801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.334742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:07.335814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:07.346737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.347280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.348338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.350275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.423137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:07.435073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:07.436610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:07.437790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7c52bc76-56a9-48c4-897f-81474346f717 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.257446 Nov 21 17:17:07.438356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 236/488] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:07 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:07.443682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:07.444898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:07.454754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.455660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.457296 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.458168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.555152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7f6c6497-41c0-43fc-92b4-2e737c3fc731 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 38065 microversion: 2.1 time: 0.114569 Nov 21 17:17:07.560019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 237/489] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:07 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 38065 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:17:07.591571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:07.604055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-54a27e01-d0b6-4414-940e-9fe70a7096d9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.277294 Nov 21 17:17:07.618094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 253/490] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:07 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:07.944256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:07.945010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:07.951289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-d838a4bf-f42b-4f6b-9db9-279cf78a65e3 req-6554b2e1-cfa7-4b29-83f2-c93d98790b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4345c73b-e834-49e9-9b9c-240c14efda0d", "name": "network-vif-deleted", "tag": "1d359723-7062-4d6d-a38a-ef4301c71739"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:07.953900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.954569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.957512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:07.957512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:07.965780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.967597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:07.977520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-d838a4bf-f42b-4f6b-9db9-279cf78a65e3 req-6554b2e1-cfa7-4b29-83f2-c93d98790b62 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:07.979109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-d838a4bf-f42b-4f6b-9db9-279cf78a65e3 req-6554b2e1-cfa7-4b29-83f2-c93d98790b62 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.003519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-d838a4bf-f42b-4f6b-9db9-279cf78a65e3 req-6554b2e1-cfa7-4b29-83f2-c93d98790b62 service nova] Creating event network-vif-deleted:1d359723-7062-4d6d-a38a-ef4301c71739 for instance 4345c73b-e834-49e9-9b9c-240c14efda0d on hv-cinder-81869 Nov 21 17:17:08.010399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-d838a4bf-f42b-4f6b-9db9-279cf78a65e3 req-6554b2e1-cfa7-4b29-83f2-c93d98790b62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080269 Nov 21 17:17:08.011078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 238/491] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:08.064078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.075091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-78b3b673-4857-43ea-a08c-5ee55ad011ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 200 len: 1303 microversion: 2.1 time: 0.134920 Nov 21 17:17:08.076198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 254/492] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:07 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:08.102281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:08.103223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:08.109978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.111071 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.111628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.111883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.313144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.329454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8c0ef0d6-cdcf-418d-b920-2548e2c3124f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.230783 Nov 21 17:17:08.330502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 239/493] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:08 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:08.457500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:08.458148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:08.464795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.465313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.466098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.466525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.569987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:08.571700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:08.580220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.581123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.582113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.582815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.676866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bf607d72-cabc-4ff8-b6fd-220904a71ce8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 200 len: 38192 microversion: 2.1 time: 0.111611 Nov 21 17:17:08.677444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 240/494] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:08 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 38192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:17:08.684095 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:08.685096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:08.692148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.693176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.696145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.697647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.713539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.735076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.738793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.741514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cf8125ea-7d89-4a61-a2d8-4998ca30ccdd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.287690 Nov 21 17:17:08.759506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 255/495] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:08 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:08.778866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:08.779389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:08.785621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.786085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.786972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:08.787412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:08.814026 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f11cd67a-a6d5-487a-a6f2-5cac50a85eb2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/ips" status: 200 len: 145 microversion: 2.1 time: 0.052485 Nov 21 17:17:08.825594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 256/496] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:17:08 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:08.908377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:08.918411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-25fd2fb0-98ca-4edb-b78d-3298c2780574 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.239030 Nov 21 17:17:08.919406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 241/497] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:08 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:09.094193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.095751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 4345c73b-e834-49e9-9b9c-240c14efda0d] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.102858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.103795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.104846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.105508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.122879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Instance 4345c73b-e834-49e9-9b9c-240c14efda0d could not be found. Nov 21 17:17:09.123886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 404 to user: Instance 4345c73b-e834-49e9-9b9c-240c14efda0d could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:09.125061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2474b2c0-0187-4a06-ac4c-f5ab995d6640 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d" status: 404 len: 111 microversion: 2.1 time: 0.034952 Nov 21 17:17:09.126212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 257/498] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:09 2021] GET /compute/v2.1/servers/4345c73b-e834-49e9-9b9c-240c14efda0d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:09.134714 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.135352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.141598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.143176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.144916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.147307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.184196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:09.285622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1a809995-da55-4da1-9d20-0fb6806e2497 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 204 len: 0 microversion: 2.1 time: 0.154708 Nov 21 17:17:09.291308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 242/499] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:09 2021] DELETE /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:09.296362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.296987 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.303957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.304708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.306068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.306507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.356175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.357357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.374724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.375542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.376966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.377774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.546684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:09.566403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-59a87d7f-9e36-442a-9822-a87783ffa564 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.273509 Nov 21 17:17:09.567503 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 258/500] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:09 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:09.594899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:09.608343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d121fa3f-8de5-4538-a579-52c50b46bb14 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.262895 Nov 21 17:17:09.616913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 243/501] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:09 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:09.775008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.775008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.788671 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.789189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.791180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.793513 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.937751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:09.938359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:09.956600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.957300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:09.958311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:09.961900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.019051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.031877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.037843 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.051329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3d82deeb-2c0a-457c-9f23-6bda82dc23ff tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.278182 Nov 21 17:17:10.059359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 259/502] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:09 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:10.185501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-252915d1-a169-4d45-b61f-07246d573c59 req-ead3fe59-d1f3-4d73-a0a8-c1218c28722b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e194a0-92ef-4d76-bee9-31816839b199", "name": "network-vif-plugged", "status": "completed", "tag": "cb6c5893-6210-499d-a5ea-685c2c4a3c95"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:10.193969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:10.193969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:10.210394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-252915d1-a169-4d45-b61f-07246d573c59 req-ead3fe59-d1f3-4d73-a0a8-c1218c28722b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:10.212240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-252915d1-a169-4d45-b61f-07246d573c59 req-ead3fe59-d1f3-4d73-a0a8-c1218c28722b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.229289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-252915d1-a169-4d45-b61f-07246d573c59 req-ead3fe59-d1f3-4d73-a0a8-c1218c28722b service nova] Creating event network-vif-plugged:cb6c5893-6210-499d-a5ea-685c2c4a3c95 for instance 29e194a0-92ef-4d76-bee9-31816839b199 on hv-cinder-81869 Nov 21 17:17:10.250050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-252915d1-a169-4d45-b61f-07246d573c59 req-ead3fe59-d1f3-4d73-a0a8-c1218c28722b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070206 Nov 21 17:17:10.251162 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 260/503] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:10.365569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.392143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-128e3cfd-7d70-4d5d-99e0-f530d2e93e31 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.458020 Nov 21 17:17:10.396805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 244/504] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:09 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:10.585904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:10.587301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:10.594726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:10.595212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.596101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:10.596613 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.626683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:10.630838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:10.637923 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:10.638751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.639742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:10.640416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:10.802654 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.814191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-629d9b31-ea36-4eac-934b-2ad37d03e1bc tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.232077 Nov 21 17:17:10.815181 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 261/505] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:10 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:10.857391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:10.870779 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4fb02cec-d9ef-4882-8100-b3a9ff724b4b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.247409 Nov 21 17:17:10.871439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 245/506] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:10 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:11.088481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:11.089788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:11.101137 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.102549 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.104136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.105099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.311685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:11.320967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:11.322529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:11.323757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-379c9bc8-bef2-4f9d-9484-7b1ba8f0b2d1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.242305 Nov 21 17:17:11.324316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 262/507] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:11 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:11.416368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:11.417627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:11.428566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.429533 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.431520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.432801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.627590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c55d0a1-200c-42ff-8f17-9d372f0c97cc"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:11.628662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:11.635082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:11.636027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.636480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.637391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.637833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.643349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-559ec36d-4e69-40c3-a2e3-0d83550f1dda tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.234209 Nov 21 17:17:11.643933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 246/508] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:11 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:11.840050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:11.840661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:11.846948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.847397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.849048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:11.849048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:11.997184 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.012443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ea11f1b5-a518-47cc-8fa0-6eeee1c98ca1 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.175299 Nov 21 17:17:12.013606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 247/509] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:11 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:12.022954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:12.025579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:12.034078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.035121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.036229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.039364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.191316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.200348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0fb2ea4b-8aa9-4e79-a290-afc1b4d19913 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.184910 Nov 21 17:17:12.200851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 248/510] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:12 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:12.358084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:12.359304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:12.371651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.372298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.373363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.373941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.547972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.565401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.567463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.568790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-38b31f30-31ae-4db1-a178-d6fb2f2a9eb7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.218793 Nov 21 17:17:12.569491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 249/511] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:12 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:12.667187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:12.668338 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:12.682669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.683583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.684563 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:12.685043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:12.877033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:12.892184 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f58e9065-e0b2-4300-a829-5b90756bbd57 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.230580 Nov 21 17:17:12.893457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 250/512] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:12 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:13.042735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:13.043720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:13.053616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.053616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.053616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.054427 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.206845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:13.216537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-18b113da-04b6-48e6-9b5c-69120c26c383 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.180573 Nov 21 17:17:13.217441 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 251/513] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:13 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:13.226542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:13.227842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:13.238887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.239775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.241247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.242084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.419219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:13.427437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7ff595fc-9c01-4fff-a82c-6ec88b06aa28 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.208756 Nov 21 17:17:13.428377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 252/514] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:13 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:13.603413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:13.604610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:13.613400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.613754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.615624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.615624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.803317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:13.813795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:13.815468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:13.816665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e00e773e-fc63-4815-9af1-0b3cac21ab96 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.226039 Nov 21 17:17:13.817236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 253/515] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:13 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:13.926314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:13.927861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:13.939365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.940163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:13.941598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:13.942413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.144311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:14.158515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-abb64dcd-2cdc-4f83-afb1-8002bc119901 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.239018 Nov 21 17:17:14.159978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 254/516] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:13 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:14.241785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:14.243809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:14.254866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.255749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.258040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.259631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.466570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:14.479100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0789eea3-a10b-4368-8dc7-3a488c217f5d tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.243690 Nov 21 17:17:14.480284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 255/517] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:14 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:14.496449 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:14.498175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:14.512613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.513468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.515091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.515879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.722113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:14.738085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8c3b7c20-2ba9-49d9-9fea-6209ad58b0d1 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.256360 Nov 21 17:17:14.739136 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 256/518] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:14 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:14.844149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:14.845222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:14.852795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.853320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:14.854256 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:14.854881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.034125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.043894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.045396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.046585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-97b5d8ab-c0f9-4654-8996-9f8863ca91ef tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.206284 Nov 21 17:17:15.047171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 257/519] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:14 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:15.189194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:15.190021 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:15.198572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.199254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.200181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.200684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.423222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.434089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9086af75-9435-4f45-91f2-fd9e0fc521f8 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.249282 Nov 21 17:17:15.435305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 258/520] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:15 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:15.502252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:15.503283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:15.515012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.515776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.517129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.517883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.717725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.726131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7e15ab2b-176f-4fda-8386-bbf03d383aa8 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.230730 Nov 21 17:17:15.728034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 259/521] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:15 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:15.760941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:15.761442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:15.768196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.768514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.769293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:15.769717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:15.967023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:15.982122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6e83e4b0-5889-4336-b84a-90c8b2cfee0a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.225246 Nov 21 17:17:15.982983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 260/522] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:15 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:16.068898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:16.069880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:16.080081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.080968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.082362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.083140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.343146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:16.353078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:16.354682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:16.356097 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ca347463-a1a5-4962-82c9-5c85f21e1889 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.291446 Nov 21 17:17:16.356930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 261/523] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:16 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:16.459656 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:16.460487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:16.468373 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.468813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.469615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.470050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.628058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:16.636543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d7ef9280-78d9-42b5-ad9c-a597e061c5ee tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.180585 Nov 21 17:17:16.637409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 262/524] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:16 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:16.743065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:16.743949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:16.750660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.751303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.752112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:16.752562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:16.913282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:16.925359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b327acb8-90d1-4779-bdf8-03927b06e087 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.186190 Nov 21 17:17:16.926677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 263/525] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:16 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:17.005220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:17.005969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:17.014233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.014709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.015497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.020452 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.184515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:17.195181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-47309a11-ec09-487a-b006-eb6e83f2b52c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.193958 Nov 21 17:17:17.196638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 264/526] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:16 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:17.375621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:17.376237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:17.382586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.384521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.385393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.385833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.619124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:17.629942 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:17.631956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:17.635657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b0cc8cc7-452d-4f96-9b83-1b353ec411aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.263409 Nov 21 17:17:17.636538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 265/527] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:17 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:17.654197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:17.654928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:17.661251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.661765 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.662494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.663330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.829278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:17.838315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-caeb0753-5bee-440a-ba98-9908da9cfb7b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.188039 Nov 21 17:17:17.838952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 266/528] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:17 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:17.946601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:17.947354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:17.955186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.955772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:17.956653 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:17.957186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.133804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:18.142747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-414d2470-7fac-4749-95df-724d5a4ae6a2 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.199958 Nov 21 17:17:18.151346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 267/529] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:17 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:18.221594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:18.222203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:18.229442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.229891 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.230706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.231140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.410952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:18.425602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-99e7fa30-0f95-4219-8cba-2e944452f3b2 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.207479 Nov 21 17:17:18.426858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 268/530] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:18 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:18.654180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:18.654837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:18.662266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.662651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.663458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.663895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.844820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:18.857012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:18.858730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:18.860338 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-715d8c50-59e4-4739-957f-8c93b98c97ed tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.210047 Nov 21 17:17:18.860987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 269/531] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:18 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:18.866350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:18.867088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:18.874737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.875447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:18.876712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:18.877394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.012574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:19.020288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-60efbfb4-c173-4789-a410-dacce806bd80 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.158108 Nov 21 17:17:19.020875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 270/532] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:18 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:19.175073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:19.176197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:19.186926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.187719 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.189109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.189905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.398937 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:19.407059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b3f79cd0-3c04-48d7-844e-1020a206b07f tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.238770 Nov 21 17:17:19.407658 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 271/533] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:19 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:19.449541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:19.450162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:19.458138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.458597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.459774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.460215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.598156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2be4921f-cb3e-442e-8a5b-3173179f9e29 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.974045 Nov 21 17:17:19.604340 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 263/534] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:17:11 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments => generated 194 bytes in 7981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:17:19.646532 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:19.660070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-44dbe6c4-5c22-4f98-bbf4-e26de783eb67 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.215597 Nov 21 17:17:19.672727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 272/535] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:19 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:19.882159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:19.883269 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:19.890381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.890872 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:19.891675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:19.892114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.043336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:20.044549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:20.051291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.057523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.058344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.059783 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.060585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.066899 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.069172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.071735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0951812c-ec36-46ba-8f74-7e0999d5b97b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.195109 Nov 21 17:17:20.072726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 264/536] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:19 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:20.214203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.221943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4f8bb67f-7e9d-4b73-add4-38b6f201ec60 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1314 microversion: 2.1 time: 0.186894 Nov 21 17:17:20.222530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 273/537] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:20 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:20.436658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:20.437090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:20.444771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.446039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.447332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.447898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.581917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.589889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a37e6182-fe44-4677-ad94-940d91e96df6 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.163025 Nov 21 17:17:20.590479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 265/538] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:20 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:20.679340 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:20.680787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:20.687674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.688035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.688822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:20.689248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:20.855257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:20.864177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e82ab60d-a5b3-41b4-97af-9c68d8db09fd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.188430 Nov 21 17:17:20.864878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 274/539] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:20 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:21.096098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:21.096940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:21.105360 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.106065 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.107811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.107811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.247343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:21.251172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:21.263589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.264969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.267068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.267961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.282040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:21.293213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:21.295151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:21.296575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-87348d93-f78a-4701-8368-1216fa3121a5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.205142 Nov 21 17:17:21.297330 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 266/540] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:21 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:21.608141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:21.609223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:21.616684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.618087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.619345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.620105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.919139 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:21.932699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9e2b3285-8fc3-4113-bb05-abf1210ac5fc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1498 microversion: 2.1 time: 0.694603 Nov 21 17:17:21.933525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 275/541] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:21 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1498 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:21.933525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:21.933525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:21.954705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.956076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.957433 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:21.958182 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:21.962225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:21.982193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-efe2d539-248e-420c-9c5a-ad1e3b7f69b5 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 200 len: 1514 microversion: 2.1 time: 0.377962 Nov 21 17:17:21.983703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 267/542] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:21 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:22.154201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:22.163786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f4c05f53-264d-4d26-b38a-0f818eee23a5 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1567 microversion: 2.1 time: 0.228791 Nov 21 17:17:22.165724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 276/543] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:21 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:22.225336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-aceb7307-c337-4b9c-886c-407102275dd3 req-535b8aa8-b99e-4639-a58c-ca783194fac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d670d19-5be0-4a50-a4fa-028b4bf0c165", "name": "network-vif-deleted", "tag": "fe30213e-c636-462d-a3c7-987c00c238b0"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:22.229382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:22.229382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:22.240932 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-aceb7307-c337-4b9c-886c-407102275dd3 req-535b8aa8-b99e-4639-a58c-ca783194fac4 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.241724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-aceb7307-c337-4b9c-886c-407102275dd3 req-535b8aa8-b99e-4639-a58c-ca783194fac4 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.270440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-aceb7307-c337-4b9c-886c-407102275dd3 req-535b8aa8-b99e-4639-a58c-ca783194fac4 service nova] Creating event network-vif-deleted:fe30213e-c636-462d-a3c7-987c00c238b0 for instance 0d670d19-5be0-4a50-a4fa-028b4bf0c165 on hv-cinder-81869 Nov 21 17:17:22.284203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-aceb7307-c337-4b9c-886c-407102275dd3 req-535b8aa8-b99e-4639-a58c-ca783194fac4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064455 Nov 21 17:17:22.292480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 268/544] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:22.319406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:22.322358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:22.340869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.341464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.342612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.343450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.525509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:22.538433 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:22.542182 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:22.543440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d5f0ac7c-58ab-48cd-939a-4bb41874fe8e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.230447 Nov 21 17:17:22.544206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 277/545] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:22 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:22.626659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:22.627247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:22.635167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.635615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.636398 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.636830 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.665866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:22.774316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2ddcd556-2d08-4009-82b6-e3d212570976 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "DELETE /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 204 len: 0 microversion: 2.1 time: 0.151242 Nov 21 17:17:22.775001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 269/546] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:22 2021] DELETE /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:22.785050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:22.785866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:22.793952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.794709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.795603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:22.796037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:22.943444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:22.952923 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-544f8f27-a214-46ef-865e-672b8d2a3631 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1504 microversion: 2.1 time: 0.171683 Nov 21 17:17:22.954085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 278/547] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:22 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:23.009969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.010718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: 0d670d19-5be0-4a50-a4fa-028b4bf0c165] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.017045 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.017498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.018291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.018760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.034007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Instance 0d670d19-5be0-4a50-a4fa-028b4bf0c165 could not be found. Nov 21 17:17:23.034615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 404 to user: Instance 0d670d19-5be0-4a50-a4fa-028b4bf0c165 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:23.035491 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b9efe933-937e-4541-916f-09582808f3ed tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165" status: 404 len: 111 microversion: 2.1 time: 0.030277 Nov 21 17:17:23.036078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 270/548] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:23 2021] GET /compute/v2.1/servers/0d670d19-5be0-4a50-a4fa-028b4bf0c165 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:23.185109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.185902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.193436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.193943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.194910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.195445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.335873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:23.345219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-abcf9cdb-7352-4724-9907-3ff800e94af7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1547 microversion: 2.1 time: 0.165878 Nov 21 17:17:23.346112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 279/549] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:23 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:23.365172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.366124 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.374484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.375253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.376474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.377261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.519732 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a5eddea-80da-4ad2-a69a-4150ee61891a while it is in vm_state rescued Nov 21 17:17:23.520339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Returning 409 to user: Cannot 'detach_volume' instance 7a5eddea-80da-4ad2-a69a-4150ee61891a while it is in vm_state rescued {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:23.521189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3a329f51-fed6-4ccc-906d-5fa254e92c7a tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments/19f9b963-1393-4cba-a11a-389283220291" status: 409 len: 152 microversion: 2.1 time: 0.161514 Nov 21 17:17:23.521759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 271/550] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:17:23 2021] DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments/19f9b963-1393-4cba-a11a-389283220291 => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 21 17:17:23.531048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:23.531576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.538541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.539651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.540762 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.541227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.566013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.567158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.583325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.583974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.585053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.585652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.623922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cbaf0950-bc39-4954-baaa-7b732bff7918 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action" status: 202 len: 0 microversion: 2.1 time: 0.096429 Nov 21 17:17:23.628494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 280/551] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:23 2021] POST /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:17:23.636226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.637308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.644200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.645400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.646042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.646485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.918997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:23.931773 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:23.934156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:23.935930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2575eb13-c8bc-4450-9751-505d57e17ad6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.376844 Nov 21 17:17:23.936749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 272/552] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:23 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:23.942926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:23.958481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-306b5c7d-6211-434e-8d4f-0a31881359bd tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1555 microversion: 2.1 time: 0.328224 Nov 21 17:17:23.959624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 281/553] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:23 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1555 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:23.982497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:23.983809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:23.995399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.996159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:23.997596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:23.998692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.176250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:24.189378 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a4054d18-7e66-4e55-9254-630fe40e37ab tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1504 microversion: 2.1 time: 0.216195 Nov 21 17:17:24.190436 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 273/554] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:23 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:24.196625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:24.197902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:24.211130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.212040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.213589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.214498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.262006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:24.369475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-08768199-f5a6-490e-a391-d84d12169ca7 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 204 len: 0 microversion: 2.1 time: 0.180926 Nov 21 17:17:24.371745 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 282/555] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:24 2021] DELETE /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:24.386612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:24.387316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:24.393978 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.394429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.395254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.395758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.546455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:24.561576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0bcdaa87-526c-441c-8c9f-781cd08e7b78 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1514 microversion: 2.1 time: 0.184313 Nov 21 17:17:24.562694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 274/556] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:24 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:24.966370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:24.967535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:24.974602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.975205 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.976117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:24.976988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:24.993679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:24.994561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:25.006293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.007497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.010358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.011453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.241958 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.252193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.254423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.256534 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-574e3be8-3a4c-44fc-911b-73589f1877d2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.294614 Nov 21 17:17:25.257561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 283/557] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:24 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:25.260359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.265632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-a1cf1ca3-1f79-44f9-b4af-d5390bee96f3 req-b153a88b-6eb1-44ae-934a-86a5aabb5543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e194a0-92ef-4d76-bee9-31816839b199", "name": "network-vif-deleted", "tag": "cb6c5893-6210-499d-a5ea-685c2c4a3c95"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:25.268615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:25.268615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:25.275675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-281cedad-9655-4f15-aec7-987fe930503c tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1555 microversion: 2.1 time: 0.289948 Nov 21 17:17:25.276774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 275/558] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:24 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:25.280753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-a1cf1ca3-1f79-44f9-b4af-d5390bee96f3 req-b153a88b-6eb1-44ae-934a-86a5aabb5543 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.281469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-a1cf1ca3-1f79-44f9-b4af-d5390bee96f3 req-b153a88b-6eb1-44ae-934a-86a5aabb5543 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.285424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:25.286607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:25.296628 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.297353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.298660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.299383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.306186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-a1cf1ca3-1f79-44f9-b4af-d5390bee96f3 req-b153a88b-6eb1-44ae-934a-86a5aabb5543 service nova] Creating event network-vif-deleted:cb6c5893-6210-499d-a5ea-685c2c4a3c95 for instance 29e194a0-92ef-4d76-bee9-31816839b199 on hv-cinder-81869 Nov 21 17:17:25.312912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-a1cf1ca3-1f79-44f9-b4af-d5390bee96f3 req-b153a88b-6eb1-44ae-934a-86a5aabb5543 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053149 Nov 21 17:17:25.313829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 284/559] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:25.342725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.343313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.343860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lazy-loading 'fault' on Instance uuid 29e194a0-92ef-4d76-bee9-31816839b199 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:17:25.389986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.398880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-74ae87d3-8685-4391-9adb-9acc49c7028d tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 200 len: 1304 microversion: 2.1 time: 0.119654 Nov 21 17:17:25.399718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 276/560] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:25 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:25.581557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:25.582685 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:25.589839 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.590516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.591457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:25.591999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:25.761570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:25.769995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e548e39b-dc33-4373-9264-db23fc680933 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1514 microversion: 2.1 time: 0.193044 Nov 21 17:17:25.770767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 285/561] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:25 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:26.299386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:26.300700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:26.306255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:26.306963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:26.311022 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.311715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.312584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.313026 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.314252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.314738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.315527 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.315969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.607080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:26.618603 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:26.622303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c99cb2d7-fd33-4ef4-a903-a5570d3ebe89 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1561 microversion: 2.1 time: 0.321093 Nov 21 17:17:26.622940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 286/562] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:26 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1561 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:26.628016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:26.628786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: 29e194a0-92ef-4d76-bee9-31816839b199] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:26.635963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.636411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.637224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.637625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.656181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] HTTP exception thrown: Instance 29e194a0-92ef-4d76-bee9-31816839b199 could not be found. Nov 21 17:17:26.657181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Returning 404 to user: Instance 29e194a0-92ef-4d76-bee9-31816839b199 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:26.659036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5cd57cd0-4786-430d-82ea-2838a0f23b1c tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199" status: 404 len: 111 microversion: 2.1 time: 0.034573 Nov 21 17:17:26.665772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 287/563] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:26 2021] GET /compute/v2.1/servers/29e194a0-92ef-4d76-bee9-31816839b199 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:26.666472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:26.669834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:26.673991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-22b123a5-a670-4a77-aa2d-baba3c627ae3 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.377863 Nov 21 17:17:26.675251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 277/564] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:26 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:26.764065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-836318188", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "194e21e2-e235-4f36-bc81-802507f8b3c9"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:26.793003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:26.794232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:26.808146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.809289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.811463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:26.812514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:26.881572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] validate_networks() for [('194e21e2-e235-4f36-bc81-802507f8b3c9', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:17:27.164545 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:27.178246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-62062d04-422c-4615-b8a7-5c450733dec4 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1514 microversion: 2.1 time: 0.393255 Nov 21 17:17:27.179362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 278/565] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:26 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:27.199838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:27.200344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:27.207347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.207823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.208636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.209069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.475971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lazy-loading 'services' on Instance uuid 7a5eddea-80da-4ad2-a69a-4150ee61891a {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:17:27.562026 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:17:27.562445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:17:27.563198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:17:27.564058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:17:27.564754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:17:27.575931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.576363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.577151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.577572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.606827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Getting quotas for project dead7671a99e42d5b3d44db11c894350. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:17:27.612348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Getting quotas for user 5401d84b70a24aa5a0011c5160fcac33 and project dead7671a99e42d5b3d44db11c894350. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:17:27.631508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:17:27.635318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:17:27.642164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f280e4e5-180b-4b9c-886c-dd649810dd08 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments/19f9b963-1393-4cba-a11a-389283220291" status: 202 len: 0 microversion: 2.1 time: 0.447841 Nov 21 17:17:27.646820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 279/566] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:17:27 2021] DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments/19f9b963-1393-4cba-a11a-389283220291 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:17:27.650026 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-01bfa451-fdc0-449f-b31f-a82ef7bf8cb8 req-b083ab72-46f6-40da-9c94-3da38d2935b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c4fbff-6877-43aa-ba5b-636ee99304f9", "name": "network-vif-deleted", "tag": "f977a3a4-4548-43ab-9bfd-8999238cf78a"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:27.651950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:27.651950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:27.663049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-01bfa451-fdc0-449f-b31f-a82ef7bf8cb8 req-b083ab72-46f6-40da-9c94-3da38d2935b2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.663485 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-01bfa451-fdc0-449f-b31f-a82ef7bf8cb8 req-b083ab72-46f6-40da-9c94-3da38d2935b2 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.679248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-01bfa451-fdc0-449f-b31f-a82ef7bf8cb8 req-b083ab72-46f6-40da-9c94-3da38d2935b2 service nova] Creating event network-vif-deleted:f977a3a4-4548-43ab-9bfd-8999238cf78a for instance e3c4fbff-6877-43aa-ba5b-636ee99304f9 on hv-cinder-81869 Nov 21 17:17:27.685335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-01bfa451-fdc0-449f-b31f-a82ef7bf8cb8 req-b083ab72-46f6-40da-9c94-3da38d2935b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040504 Nov 21 17:17:27.686268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 280/567] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:27.692092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1e488ce5-3eec-4266-b81c-777b331faf42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:27.699991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e488ce5-3eec-4266-b81c-777b331faf42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.700487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e488ce5-3eec-4266-b81c-777b331faf42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.711905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7ae11143-c7ae-4b44-8a30-07f6003c55ba tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959803 Nov 21 17:17:27.713551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 288/568] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:17:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:17:27.737655 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:27.739804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:27.761949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.763111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.775889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.776106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1e488ce5-3eec-4266-b81c-777b331faf42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Going to try to stop instance {{(pid=115854) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 21 17:17:27.776643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.837500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1e488ce5-3eec-4266-b81c-777b331faf42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 202 len: 0 microversion: 2.1 time: 0.149601 Nov 21 17:17:27.838279 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 281/569] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:27 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:17:27.844287 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:27.845466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:27.854512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.855293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.856459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:27.857338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:27.862244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-adf8f04d-f953-4705-ad01-c470ee84701f tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146226 Nov 21 17:17:27.864012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 289/570] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:17:27 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:27.873374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0f89ff55-ee7b-421d-b88b-c382bd57b00b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:27.875031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0f89ff55-ee7b-421d-b88b-c382bd57b00b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:28.002490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0f89ff55-ee7b-421d-b88b-c382bd57b00b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.028292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0f89ff55-ee7b-421d-b88b-c382bd57b00b tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1213 microversion: 2.1 time: 0.161934 Nov 21 17:17:28.030536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 290/571] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:27 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:28.044717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:28.060712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:28.079907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.080631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.086733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.087655 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.111083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.125283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.126343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.127816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1bf8ffd4-b840-4d12-9e5a-6d0255f55046 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.288085 Nov 21 17:17:28.128786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 282/572] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:27 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:28.214063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:28.216821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:28.227825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.228443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.229707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.230313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.288413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.289147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.289952 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lazy-loading 'fault' on Instance uuid e3c4fbff-6877-43aa-ba5b-636ee99304f9 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:17:28.361873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6cd4fc3c724700b710d79faca5e698', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89340607dc524f939683b019c1853d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.374464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-addc8156-07d4-409d-a668-4cd5c0107596 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 200 len: 1308 microversion: 2.1 time: 0.173989 Nov 21 17:17:28.388756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 283/573] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:28 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:28.423187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:28.444504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-47129185-1fdd-465f-a679-e86ec6d838cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.411633 Nov 21 17:17:28.445788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 291/574] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:28 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:28.875927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:28.876805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:28.883133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.883653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.884451 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:28.884878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:28.917561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fa601e2e-1f62-4d37-89c5-982b36490081 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045505 Nov 21 17:17:28.918153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 284/575] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:17:28 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:17:29.047094 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:29.047886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:29.054562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.055120 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.055955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.056448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.162019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:29.162659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:29.170093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.170539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.171374 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.171809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.180167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:29.194887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7a9edc1e-2b5c-4496-90e2-f572a6c1effc tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1265 microversion: 2.1 time: 0.151333 Nov 21 17:17:29.196795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 292/576] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:29 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:29.384161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:29.399968 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:29.403062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:29.405490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-df472d9b-15cd-4691-a731-0bd7ca93afe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.247169 Nov 21 17:17:29.406674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:29.406882 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 285/577] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:29 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:29.407861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] [instance: e3c4fbff-6877-43aa-ba5b-636ee99304f9] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:29.432228 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.436645 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.438150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.438150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.457530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] HTTP exception thrown: Instance e3c4fbff-6877-43aa-ba5b-636ee99304f9 could not be found. Nov 21 17:17:29.458355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] Returning 404 to user: Instance e3c4fbff-6877-43aa-ba5b-636ee99304f9 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:29.459494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aa0cd0ba-b803-4e18-896c-234472a07c84 tempest-AttachVolumeNegativeTest-64209544 tempest-AttachVolumeNegativeTest-64209544-project] 10.222.0.52 "GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9" status: 404 len: 111 microversion: 2.1 time: 0.060964 Nov 21 17:17:29.460204 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 293/578] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:29 2021] GET /compute/v2.1/servers/e3c4fbff-6877-43aa-ba5b-636ee99304f9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 17:17:29.477297 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:29.478645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:29.490717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.491537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.494319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:29.495171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:29.765487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:29.774507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-80605f95-12f5-45e1-9f54-0f03ddeb8b4b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.303270 Nov 21 17:17:29.784552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 286/579] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:29 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:30.171198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-312ba233-fa82-4ab6-86cb-4e7968ad4f65 req-77fe9cda-7733-4014-a36b-823c81a83940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "name": "network-vif-plugged", "status": "completed", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:30.173683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:30.173683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:30.183921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-312ba233-fa82-4ab6-86cb-4e7968ad4f65 req-77fe9cda-7733-4014-a36b-823c81a83940 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.184773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-312ba233-fa82-4ab6-86cb-4e7968ad4f65 req-77fe9cda-7733-4014-a36b-823c81a83940 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.204125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-312ba233-fa82-4ab6-86cb-4e7968ad4f65 req-77fe9cda-7733-4014-a36b-823c81a83940 service nova] Creating event network-vif-plugged:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:17:30.224633 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:30.229061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:30.252520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-312ba233-fa82-4ab6-86cb-4e7968ad4f65 req-77fe9cda-7733-4014-a36b-823c81a83940 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091019 Nov 21 17:17:30.272820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 294/580] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:17:30.279415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.280155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.287250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.288042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.431031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:30.432362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:30.457294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.459337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.461770 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.462864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.616665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:30.634560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2373dcd1-e3fd-4d05-99a0-002401ebe8d5 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.421070 Nov 21 17:17:30.637852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 287/581] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:30 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:30.730100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:30.751103 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:30.754236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:30.756097 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a53f72b7-dba5-49ee-aa1b-0f12a43172c0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.333341 Nov 21 17:17:30.757517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 295/582] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:30 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:30.795254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:30.796531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:30.813975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.820064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:30.821220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:30.821697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.199449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:31.211945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e99cdc6d-7d81-4534-a0f0-1ebfb2728d4e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.422102 Nov 21 17:17:31.212710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 288/583] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:30 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:31.394041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-f055f2f7-aba5-4a00-809f-a12a765a7d33 req-990548e6-c64a-4226-8a2e-3953f38ce7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb7b3fb-947e-4397-bc52-11bd72449a5e", "tag": "08a5ee21-3681-4f10-b7a8-5d71a2f325d9"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:31.409143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:31.409143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:31.432315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-f055f2f7-aba5-4a00-809f-a12a765a7d33 req-990548e6-c64a-4226-8a2e-3953f38ce7f0 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.432905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-f055f2f7-aba5-4a00-809f-a12a765a7d33 req-990548e6-c64a-4226-8a2e-3953f38ce7f0 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.449203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:31.450462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:31.450857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-f055f2f7-aba5-4a00-809f-a12a765a7d33 req-990548e6-c64a-4226-8a2e-3953f38ce7f0 service nova] Creating event network-changed:08a5ee21-3681-4f10-b7a8-5d71a2f325d9 for instance acb7b3fb-947e-4397-bc52-11bd72449a5e on hv-cinder-81869 Nov 21 17:17:31.457871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-f055f2f7-aba5-4a00-809f-a12a765a7d33 req-990548e6-c64a-4226-8a2e-3953f38ce7f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080091 Nov 21 17:17:31.458878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 296/584] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:31.461792 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.462507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.463766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.464492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.514301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:31.629793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-036dcd51-2267-4118-ac05-a4701f5a6358 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 204 len: 0 microversion: 2.1 time: 0.187337 Nov 21 17:17:31.630838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 289/585] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:31 2021] DELETE /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:31.643506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:31.644539 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:31.659871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.660319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.660585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:31.661107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.661529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.667363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:31.684211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.685091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.686743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.687717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.876415 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:31.896558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dfb20fe7-febd-4f3a-b07c-674d96e136d9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1507 microversion: 2.1 time: 0.258357 Nov 21 17:17:31.902473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 297/586] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:31 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:31.908042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:31.908929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:31.916127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.916888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.918044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:31.918889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:31.924133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:31.944429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b7418de1-1f5f-4ecf-9926-74ebe3985b22 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.287955 Nov 21 17:17:31.959440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 290/587] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:31 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:32.096676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:32.113136 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:32.115394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:32.117968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-621845b1-3804-4e85-b0a1-5a27cc0f8380 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.212919 Nov 21 17:17:32.119101 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 298/588] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:31 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:32.239177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:32.240445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:32.250578 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:32.252161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:32.252161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:32.252980 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:32.419110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:32.439749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f8211c5a-55b4-48de-99e6-b70a010933f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.205427 Nov 21 17:17:32.439749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 291/589] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:32 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:32.928176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:32.929946 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:32.937290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:32.938286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:32.939419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:32.940099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:32.979403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:32.981417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:32.998566 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:32.999984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.001433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:33.002142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.243334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.262610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-00ae006a-9b89-4704-9a85-83ab08e0027b tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1507 microversion: 2.1 time: 0.338181 Nov 21 17:17:33.280242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 299/590] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:32 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:33.296155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:33.297603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:33.310445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:33.311765 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.313615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:33.314935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.334991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.351780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4522f911-899c-413d-a722-a19bc089192e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.382105 Nov 21 17:17:33.353387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 292/591] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:32 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:33.463515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:33.464944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:33.479580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:33.480390 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.481616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:33.482303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:33.547178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.561700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.563842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.566288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bb8bdefe-f92d-40dd-b0be-069e88673d3b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1809 microversion: 2.20 time: 0.284476 Nov 21 17:17:33.567576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 300/592] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:33 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:17:33.677570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:33.698800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9e900103-5c62-431c-96fd-fee1e06380a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.241587 Nov 21 17:17:33.699613 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 293/593] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:33 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:34.298206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:34.299035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:34.307006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.307778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.309430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.310500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.378110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:34.380679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:34.390989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.392731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.392731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.393310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.496091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.505964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8bc69b60-a562-4e0f-8f59-bf6f3202b1d7 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1507 microversion: 2.1 time: 0.213235 Nov 21 17:17:34.508599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 301/594] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:34 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:34.597567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:34.598603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:34.609134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.609998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.611197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.612089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.621457 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.637326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a400f6c2-9d09-4eaa-9411-0361133cfbde tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.263029 Nov 21 17:17:34.639000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 294/595] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:34 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:34.719047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:34.720057 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:34.727951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.735532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.736764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.737218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.781000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.790648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.792524 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.794030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5e2ba078-08fe-4f2a-ba00-8412c455de80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1796 microversion: 2.20 time: 0.201319 Nov 21 17:17:34.794601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 302/596] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:17:34 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1796 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:17:34.928544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:34.939321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-18b15e68-ee76-4a95-a588-f1e9f0004a3a req-82743993-275d-4448-b4b4-a693427298c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9bda498-a1ce-48c5-81a0-2aeb932f2ad3", "name": "network-vif-deleted", "tag": "488447a4-db33-45b2-a3c1-19d43272bd72"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:34.942446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:34.942446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:34.949917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-20508665-2b2d-41c0-a262-6c95294ef397 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.234096 Nov 21 17:17:34.950893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 295/597] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:34 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:34.955787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-18b15e68-ee76-4a95-a588-f1e9f0004a3a req-82743993-275d-4448-b4b4-a693427298c3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:34.956958 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-18b15e68-ee76-4a95-a588-f1e9f0004a3a req-82743993-275d-4448-b4b4-a693427298c3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:34.975350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-18b15e68-ee76-4a95-a588-f1e9f0004a3a req-82743993-275d-4448-b4b4-a693427298c3 service nova] Creating event network-vif-deleted:488447a4-db33-45b2-a3c1-19d43272bd72 for instance b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 on hv-cinder-81869 Nov 21 17:17:34.982998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-18b15e68-ee76-4a95-a588-f1e9f0004a3a req-82743993-275d-4448-b4b4-a693427298c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047928 Nov 21 17:17:34.987259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 303/598] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:17:35.529688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:35.530966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:35.543528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.544565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.546152 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.547013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.621267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.622098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.622976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lazy-loading 'fault' on Instance uuid b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:17:35.658077 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:35.658963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:35.665877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.668920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:35.669436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.670289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.670764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.676326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-51a43336-7b90-48e4-a65a-6db2e6000cab tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 200 len: 1312 microversion: 2.1 time: 0.154531 Nov 21 17:17:35.676922 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 296/599] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:35 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:35.848954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:35.858827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fa42b5e4-f67e-44e7-9eee-37ec2b0a01b6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.205185 Nov 21 17:17:35.859423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 304/600] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:35 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:35.968738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:35.969487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:35.976175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.977884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:35.978734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:35.979167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.207862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:36.223337 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-56d0a038-9664-48c6-92f7-bd2d0fb81cdb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.258048 Nov 21 17:17:36.224511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 297/601] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:35 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:36.701988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:36.702825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: b9bda498-a1ce-48c5-81a0-2aeb932f2ad3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:36.711615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.712623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.713681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.714482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.742877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] HTTP exception thrown: Instance b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 could not be found. Nov 21 17:17:36.744426 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Returning 404 to user: Instance b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:36.746300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bc7923fa-c579-4869-928c-4cdf15acd2a8 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3" status: 404 len: 111 microversion: 2.1 time: 0.049195 Nov 21 17:17:36.752661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 305/602] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:36 2021] GET /compute/v2.1/servers/b9bda498-a1ce-48c5-81a0-2aeb932f2ad3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:36.757178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:36.757892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:36.764452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.764846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.765743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.766030 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.811329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:36.883251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:36.884017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:36.890825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.891277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.892063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.892495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.910603 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-64e89f3e-bbae-44b4-923f-29a93b20342d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 204 len: 0 microversion: 2.1 time: 0.156904 Nov 21 17:17:36.911590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 298/603] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:36 2021] DELETE /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 17:17:36.921925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:36.922729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:36.930432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.931040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:36.931987 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:36.932550 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:37.119527 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:37.126595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:37.132591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ffbf75e4-70f9-488d-8b15-4677816094b1 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.252913 Nov 21 17:17:37.133970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 306/604] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:36 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:37.142962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cf1cf0af-1953-4691-903f-dd5481cb59ed tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.225099 Nov 21 17:17:37.146666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 299/605] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:36 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:37.258999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:37.259602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:37.266781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:37.267583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:37.268827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:37.269445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:37.429900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:37.449081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cc114e36-99d4-4289-b317-1006be4ba3f4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.193425 Nov 21 17:17:37.450334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 307/606] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:37 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:38.155034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:38.156114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:38.164283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.164732 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.165757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.166189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.173713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:38.175143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:38.185938 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.187263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.187838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.188390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.340568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:38.348806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-24ad1c5a-178d-4475-9711-3594ef7d1ba9 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.201419 Nov 21 17:17:38.349480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 300/607] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:38 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:38.354326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-a3bbb7e4-7948-46d8-a65e-bf1922bcca05 req-b94b85a2-0483-41ff-a998-394a36fd142e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb7b3fb-947e-4397-bc52-11bd72449a5e", "name": "network-vif-plugged", "status": "completed", "tag": "08a5ee21-3681-4f10-b7a8-5d71a2f325d9"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:38.356118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:38.356118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:38.368201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a3bbb7e4-7948-46d8-a65e-bf1922bcca05 req-b94b85a2-0483-41ff-a998-394a36fd142e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.368919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a3bbb7e4-7948-46d8-a65e-bf1922bcca05 req-b94b85a2-0483-41ff-a998-394a36fd142e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.381167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-a3bbb7e4-7948-46d8-a65e-bf1922bcca05 req-b94b85a2-0483-41ff-a998-394a36fd142e service nova] Creating event network-vif-plugged:08a5ee21-3681-4f10-b7a8-5d71a2f325d9 for instance acb7b3fb-947e-4397-bc52-11bd72449a5e on hv-cinder-81869 Nov 21 17:17:38.386686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-a3bbb7e4-7948-46d8-a65e-bf1922bcca05 req-b94b85a2-0483-41ff-a998-394a36fd142e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036006 Nov 21 17:17:38.388020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 301/608] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:38.398799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:38.407121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8efe3b0c-02a3-48d7-8e73-402cf4f6c72d tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.241297 Nov 21 17:17:38.407720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 308/609] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:38 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:38.472817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:38.473795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:38.483766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.484611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.486054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:38.486896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:38.660838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:38.670203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8b8ce4e4-b89c-419d-953c-3494f20bbf1e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.202286 Nov 21 17:17:38.670722 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 302/610] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:38 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:39.367290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:39.367880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:39.373924 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.374368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.375190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.375635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.425919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:39.426909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:39.442295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.443443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.445808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.446657 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.516686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:39.525890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2037398f-00d5-41e2-8990-026b46d146e6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1313 microversion: 2.1 time: 0.162947 Nov 21 17:17:39.526502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 309/611] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:39 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:39.630942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:39.639061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5faaca7b-f206-4dbc-b4db-fea07c810e35 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.217913 Nov 21 17:17:39.639647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 303/612] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:39 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:39.688705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:39.689436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:39.696720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.697250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.698078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:39.698519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:39.836790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:39.846275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aa7dd5dc-dd5b-4538-854b-b320557eb906 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.161253 Nov 21 17:17:39.847259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 310/613] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:39 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:40.546686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:40.548148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:40.555751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.556275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:40.557343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.557920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:40.659448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:40.660216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:40.667107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.667556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:40.668356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.668792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:40.722679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:40.732688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-871b1ec8-2fee-4f16-9afb-8888168e8e67 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1496 microversion: 2.1 time: 0.191000 Nov 21 17:17:40.733609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 304/614] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:40 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1496 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:40.847055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:40.856061 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dbe2884d-31ac-4e78-b03c-7f220a528476 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.201064 Nov 21 17:17:40.856900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 311/615] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:40 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:40.874317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:40.875276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:40.883743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.884492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:40.885576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:40.886020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.067760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:41.081546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-08d022da-3e2a-4c06-98e7-11aa630740f3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.212292 Nov 21 17:17:41.082533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 305/616] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:40 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:41.290784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:41.291663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:41.302614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.303416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.305962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.306853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.358409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:17:41.467914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6d130c91-bf27-4290-a02b-202307dccf4e tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "DELETE /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 204 len: 0 microversion: 2.1 time: 0.183411 Nov 21 17:17:41.468640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 312/617] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:17:41 2021] DELETE /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:17:41.478245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:41.478532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:41.485099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.485557 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.486341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.486813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.652778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:41.660664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-062d2e0a-da45-4b01-9830-9e04f3b947a6 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1502 microversion: 2.1 time: 0.186972 Nov 21 17:17:41.661255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 306/618] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:41 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:41.877435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:41.878500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:41.886223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.886702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:41.887508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:41.887940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:42.030138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:42.039057 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-89268299-9018-43b9-8c00-2cef3c117a37 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.165828 Nov 21 17:17:42.039766 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 313/619] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:41 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:42.102310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:42.103073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:42.109419 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:42.109964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:42.110865 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:42.111403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:42.268642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:42.278496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-39473e3d-60e2-407e-aa35-d3f5578f16f6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.180951 Nov 21 17:17:42.279469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 307/620] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:42 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:42.683065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:42.684018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:42.691636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:42.692232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:42.693169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:42.693708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:42.880574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:42.891801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-196ede1d-ce79-4b3b-9263-3d558f7d74db tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1502 microversion: 2.1 time: 0.215047 Nov 21 17:17:42.892669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 314/621] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:42 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:43.058648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:43.060244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:43.080293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.082969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.084187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.085188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.302943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:43.304237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:43.312483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.313670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.315213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.315969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.797540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10a3b3e097c4e809f2ccad5d315284f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ef489be46143b6a5b731519ccf5ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:43.810574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5ed47faa-ea42-4bc5-9c8e-4778fbc20ae9 tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 200 len: 1521 microversion: 2.1 time: 0.756181 Nov 21 17:17:43.811550 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 308/622] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:43 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:43.824485 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-f39e3fb4-4e09-4ef7-8e22-5fa991b40978 req-7ae9b85e-93b6-4f04-81d8-f9efc9a67736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5eddea-80da-4ad2-a69a-4150ee61891a", "name": "network-vif-deleted", "tag": "5cddc54e-aef1-4714-acda-c873e87ed0e4"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:43.826880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:43.826880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:17:43.834374 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-f39e3fb4-4e09-4ef7-8e22-5fa991b40978 req-7ae9b85e-93b6-4f04-81d8-f9efc9a67736 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.834871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-f39e3fb4-4e09-4ef7-8e22-5fa991b40978 req-7ae9b85e-93b6-4f04-81d8-f9efc9a67736 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.847808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-f39e3fb4-4e09-4ef7-8e22-5fa991b40978 req-7ae9b85e-93b6-4f04-81d8-f9efc9a67736 service nova] Creating event network-vif-deleted:5cddc54e-aef1-4714-acda-c873e87ed0e4 for instance 7a5eddea-80da-4ad2-a69a-4150ee61891a on hv-cinder-81869 Nov 21 17:17:43.855078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-f39e3fb4-4e09-4ef7-8e22-5fa991b40978 req-7ae9b85e-93b6-4f04-81d8-f9efc9a67736 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040929 Nov 21 17:17:43.855995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 309/623] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:43.914329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:43.915788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:43.926975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.928126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.930202 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:43.931422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:43.945715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:43.960425 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9f5669cb-50cb-4d57-bbd8-ea39eb251b37 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.661784 Nov 21 17:17:43.971618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 315/624] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:43 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:44.230712 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401d84b70a24aa5a0011c5160fcac33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dead7671a99e42d5b3d44db11c894350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:44.239923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2c83211a-599e-43e2-80f3-61a483eb7730 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 200 len: 1502 microversion: 2.1 time: 0.332490 Nov 21 17:17:44.240859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 310/625] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:43 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 1502 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:44.475400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-9b9b0064-a837-46db-953c-bfb56473cd5d req-1dc273cc-6cb5-426b-898f-429ba1949607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb7b3fb-947e-4397-bc52-11bd72449a5e", "name": "network-vif-deleted", "tag": "08a5ee21-3681-4f10-b7a8-5d71a2f325d9"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:44.479178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:17:44.479178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:17:44.490956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9b9b0064-a837-46db-953c-bfb56473cd5d req-1dc273cc-6cb5-426b-898f-429ba1949607 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:44.491531 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-9b9b0064-a837-46db-953c-bfb56473cd5d req-1dc273cc-6cb5-426b-898f-429ba1949607 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:44.513481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-9b9b0064-a837-46db-953c-bfb56473cd5d req-1dc273cc-6cb5-426b-898f-429ba1949607 service nova] Creating event network-vif-deleted:08a5ee21-3681-4f10-b7a8-5d71a2f325d9 for instance acb7b3fb-947e-4397-bc52-11bd72449a5e on hv-cinder-81869 Nov 21 17:17:44.527492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-9b9b0064-a837-46db-953c-bfb56473cd5d req-1dc273cc-6cb5-426b-898f-429ba1949607 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075096 Nov 21 17:17:44.528780 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 316/626] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:17:44.831373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:44.832180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] [instance: 7a5eddea-80da-4ad2-a69a-4150ee61891a] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:44.840456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:44.840985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:44.841810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:44.842379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:44.859013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] HTTP exception thrown: Instance 7a5eddea-80da-4ad2-a69a-4150ee61891a could not be found. Nov 21 17:17:44.859623 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] Returning 404 to user: Instance 7a5eddea-80da-4ad2-a69a-4150ee61891a could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:44.860670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8667c1b3-91c7-4ca6-9d85-3769bd8d347e tempest-ServerRescueNegativeTestJSON-1888361628 tempest-ServerRescueNegativeTestJSON-1888361628-project] 10.222.0.52 "GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a" status: 404 len: 111 microversion: 2.1 time: 0.035325 Nov 21 17:17:44.861253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 311/627] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:44 2021] GET /compute/v2.1/servers/7a5eddea-80da-4ad2-a69a-4150ee61891a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:44.990965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:44.992253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:44.999430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:44.999886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:45.000966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:45.001580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:45.250344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:45.260109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d7dee4ed-2e95-44ab-bd34-b1b5322f502f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.273973 Nov 21 17:17:45.263187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 317/628] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:44 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:45.280206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:45.281259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] [instance: acb7b3fb-947e-4397-bc52-11bd72449a5e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:45.290409 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:45.290944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:45.291832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:45.292309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:45.308144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] HTTP exception thrown: Instance acb7b3fb-947e-4397-bc52-11bd72449a5e could not be found. Nov 21 17:17:45.308740 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] Returning 404 to user: Instance acb7b3fb-947e-4397-bc52-11bd72449a5e could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:17:45.309597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3d32a997-fe51-456e-a22b-910060981485 tempest-VolumesActionsTest-722167985 tempest-VolumesActionsTest-722167985-project] 10.222.0.52 "GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e" status: 404 len: 111 microversion: 2.1 time: 0.044901 Nov 21 17:17:45.310184 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 312/629] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:45 2021] GET /compute/v2.1/servers/acb7b3fb-947e-4397-bc52-11bd72449a5e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:17:46.290040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:46.291296 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:46.300473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:46.301231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:46.302841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:46.303581 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:46.578112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:46.590278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0c130518-30da-47ce-948f-04492d164b88 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.307594 Nov 21 17:17:46.590909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 318/630] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:46 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:47.614233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:47.615681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:47.626378 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:47.627440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:47.629189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:47.630074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:47.848161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:47.859590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d74e0a49-805c-4e00-9e2b-d08efc092655 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.254537 Nov 21 17:17:47.860490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 313/631] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:47 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:48.880784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:48.881506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:48.888737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:48.889187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:48.889977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:48.890416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:49.132503 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:49.147402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-735195ff-9ee3-4111-a65d-6fdec688058b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.270340 Nov 21 17:17:49.159025 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 319/632] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:48 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:50.171983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:50.173508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:50.183336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:50.184227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:50.185627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:50.186261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:50.356311 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:50.371710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0bc39483-4515-40d0-a372-1d917357aedb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.203144 Nov 21 17:17:50.373091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 314/633] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:50 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:51.393287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:51.398301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:51.416624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:51.419609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:51.423955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:51.425492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:51.660567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:51.671305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-27b6c6be-c9b7-445d-a0d8-1526b14bd4f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.284680 Nov 21 17:17:51.682974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 320/634] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:51 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:52.692521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:52.693144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:52.709098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:52.710396 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:52.711975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:52.722960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:52.914923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:52.929928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d3ab5f37-81f3-41aa-bf0c-b35f2c7beb46 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.242996 Nov 21 17:17:52.931270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 315/635] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:52 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:53.963861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:53.965178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:53.978526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:53.980126 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:53.982091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:53.983258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:54.192038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:54.217812 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a66650d9-f9d9-4f10-8501-8828d70cdc86 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1722 microversion: 2.1 time: 0.261783 Nov 21 17:17:54.219822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 321/636] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:53 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:54.508403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-997191352", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:54.648064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] validate_networks() for None {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:17:55.102498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:17:55.103197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:17:55.103784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:17:55.104301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:17:55.104840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:17:55.125605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.131335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.133759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.138965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.171177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Getting quotas for project e9da08c51551493d88ab327519e5853a. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:17:55.176761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Getting quotas for user e686687921104d0dad016ef7d97031dd and project e9da08c51551493d88ab327519e5853a. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:17:55.191519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:17:55.194888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:17:55.247838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:55.248416 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:55.253847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-262b5d38-3bf8-46ff-a3d3-5e524009c199 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753183 Nov 21 17:17:55.255024 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 316/637] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:17:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:17:55.267808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-62adf61f-49e6-4084-a7e1-b1cd00aadb5e tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:55.268826 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-62adf61f-49e6-4084-a7e1-b1cd00aadb5e tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:55.278081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.280936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.287819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.290145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.343209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-62adf61f-49e6-4084-a7e1-b1cd00aadb5e tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:55.350342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-62adf61f-49e6-4084-a7e1-b1cd00aadb5e tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1214 microversion: 2.1 time: 0.086331 Nov 21 17:17:55.353257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 317/638] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:55 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:55.571133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:55.587030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9742eda8-36b8-4c74-a1d2-e6c21e0c9bc8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1699 microversion: 2.1 time: 0.345734 Nov 21 17:17:55.589696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 322/639] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:55 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1699 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:55.605667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ef8be689-fe5d-4805-8097-a64dda670b0a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:17:55.616793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef8be689-fe5d-4805-8097-a64dda670b0a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.617915 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef8be689-fe5d-4805-8097-a64dda670b0a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.664077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ef8be689-fe5d-4805-8097-a64dda670b0a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Going to try to start instance {{(pid=115854) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 21 17:17:55.753438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ef8be689-fe5d-4805-8097-a64dda670b0a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 202 len: 0 microversion: 2.1 time: 0.151187 Nov 21 17:17:55.770331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 318/640] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:17:55 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:17:55.779595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:55.780918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:55.793725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.794777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:55.796128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:55.796682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:56.129948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:56.141008 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4f245232-220a-41ad-8782-ff9f7c8b362e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1708 microversion: 2.1 time: 0.365909 Nov 21 17:17:56.156298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 323/641] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:55 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1708 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:56.377802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:56.392022 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:56.404327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:56.405039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:56.405842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:56.406277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:56.512931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:56.521112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d4736b44-9082-41c6-ad86-e6eaf3dfbe54 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1210 microversion: 2.1 time: 0.150949 Nov 21 17:17:56.521702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 319/642] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:56 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:17:57.165311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:57.166936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:57.188294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:57.189106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:57.191476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:57.193514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:57.454403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:57.468006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a9284a15-9f62-4aee-a6db-28947fc91058 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1708 microversion: 2.1 time: 0.311747 Nov 21 17:17:57.480974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 324/643] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:57 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1708 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:57.543661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:57.545014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:57.554431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:57.555287 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:57.556336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:57.556943 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:57.701714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:57.716367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bdb006a0-03d1-43c3-ab50-1238eec72c86 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1272 microversion: 2.1 time: 0.178406 Nov 21 17:17:57.721256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 320/644] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:57 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:58.485618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:58.486996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:58.496707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:58.497451 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:58.515815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:58.517183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:58.735794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:17:58.735794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:17:58.770153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:58.770798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:58.771981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:17:58.773993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:17:59.260719 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:59.278824 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ef2d11ed-add9-4211-b4ba-c1ad6aa0a937 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1712 microversion: 2.1 time: 0.797128 Nov 21 17:17:59.292042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 325/645] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:58 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1712 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:17:59.297777 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:17:59.313764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-68243031-44d2-4a26-8952-40cdcdde6148 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.582067 Nov 21 17:17:59.315272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 321/646] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:17:58 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:00.126054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-07b557c3-3b16-4d6d-a838-262438e3aaa7 req-a259ac9b-713a-43f9-af5a-71570a4fec07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0b5fe0-3814-4c88-8f12-f97169aabda3", "tag": "fa9451c8-0ff0-4845-b11b-3163537f65f0"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:00.127955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:00.127955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:00.153440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-07b557c3-3b16-4d6d-a838-262438e3aaa7 req-a259ac9b-713a-43f9-af5a-71570a4fec07 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:00.155365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-07b557c3-3b16-4d6d-a838-262438e3aaa7 req-a259ac9b-713a-43f9-af5a-71570a4fec07 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:00.174112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-07b557c3-3b16-4d6d-a838-262438e3aaa7 req-a259ac9b-713a-43f9-af5a-71570a4fec07 service nova] Creating event network-changed:fa9451c8-0ff0-4845-b11b-3163537f65f0 for instance 8a0b5fe0-3814-4c88-8f12-f97169aabda3 on hv-cinder-81869 Nov 21 17:18:00.182746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-07b557c3-3b16-4d6d-a838-262438e3aaa7 req-a259ac9b-713a-43f9-af5a-71570a4fec07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060330 Nov 21 17:18:00.184228 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 326/647] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:00.336702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:00.338203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:00.345129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:00.345832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:00.346902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:00.347498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:00.590407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:00.600147 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bcefb77d-ed2a-451d-98fe-b96870fadd21 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.271811 Nov 21 17:18:00.603580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 322/648] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:00 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:01.630880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:01.633191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:01.640080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:01.640909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:01.642002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:01.642702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:01.889756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:01.902496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-78623601-e03f-4bed-8c6e-4acafeacc315 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.277075 Nov 21 17:18:01.903704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 327/649] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:01 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:02.924633 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:02.925705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:02.942025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:02.942819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:02.945562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:02.946544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:03.206195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:03.215719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9c1c6810-51c5-42cd-8e43-3680eb575eec tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.297986 Nov 21 17:18:03.227020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 323/650] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:02 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:04.233853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:04.234463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:04.251564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:04.252312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:04.253262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:04.253871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:04.442864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:04.454948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3a9f1ad9-5d4f-4dd1-b712-4daddf0b05bf tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.224469 Nov 21 17:18:04.470673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 328/651] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:04 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:05.478762 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:05.479511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:05.488036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:05.488860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:05.490249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:05.491487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:05.670427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:05.680877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d93b7b46-5844-49ea-ab51-5dc8f7cc42a6 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.207009 Nov 21 17:18:05.682014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 324/652] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:05 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:06.699630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:06.701461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:06.708566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:06.709013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:06.710024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:06.710659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:06.868345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:06.876499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ed483dde-be65-4d5e-a7d9-8c68894c6985 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.180834 Nov 21 17:18:06.886996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 329/653] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:06 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:07.896530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:07.898395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:07.905914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:07.906486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:07.907573 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:07.908230 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:08.058368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:08.066247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ef5c560c-02f9-4374-a6e7-03c56fbec39b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.173624 Nov 21 17:18:08.067216 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 325/654] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:07 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:09.086482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:09.087390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:09.093191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:09.093698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:09.094877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:09.095210 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:09.338964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:09.346449 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-68c09b23-5784-477f-a88a-f23c9042109b tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.264458 Nov 21 17:18:09.347069 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 330/655] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:09 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:10.365481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:10.369163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:10.383803 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:10.384255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:10.385049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:10.385485 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:10.454578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-046884d6-9643-4deb-9f22-0784dbf9493d req-e106fbc4-a4d6-4b3a-bed4-4375e12478dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0b5fe0-3814-4c88-8f12-f97169aabda3", "name": "network-vif-plugged", "status": "completed", "tag": "fa9451c8-0ff0-4845-b11b-3163537f65f0"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:10.456485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:10.456485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:10.465820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-046884d6-9643-4deb-9f22-0784dbf9493d req-e106fbc4-a4d6-4b3a-bed4-4375e12478dd service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:10.466457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-046884d6-9643-4deb-9f22-0784dbf9493d req-e106fbc4-a4d6-4b3a-bed4-4375e12478dd service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:10.478970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-046884d6-9643-4deb-9f22-0784dbf9493d req-e106fbc4-a4d6-4b3a-bed4-4375e12478dd service nova] Creating event network-vif-plugged:fa9451c8-0ff0-4845-b11b-3163537f65f0 for instance 8a0b5fe0-3814-4c88-8f12-f97169aabda3 on hv-cinder-81869 Nov 21 17:18:10.485730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-046884d6-9643-4deb-9f22-0784dbf9493d req-e106fbc4-a4d6-4b3a-bed4-4375e12478dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034839 Nov 21 17:18:10.488712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 331/656] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:10.609920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:10.624994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bf4769bd-6571-4710-b5f9-06d5955e89d0 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.262931 Nov 21 17:18:10.626058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 326/657] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:10 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:11.645217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:11.646112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:11.653847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:11.654371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:11.655257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:11.655679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:11.791481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:11.804574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-93528b0f-ddd0-429b-b8af-1ddcafca4530 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1314 microversion: 2.1 time: 0.163111 Nov 21 17:18:11.806178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 332/658] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:11 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:12.827698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:12.828402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:12.834515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:12.835061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:12.835894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:12.836395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:13.020499 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:13.028489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ba3f5349-eee7-4bef-b2ea-b00a505ddbb4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1463 microversion: 2.1 time: 0.204479 Nov 21 17:18:13.029741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 327/659] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:12 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:13.075835 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:13.077267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:13.112945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:13.114040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:13.115694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:13.116290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:13.143431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:18:13.233413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8b5f9751-afb6-4325-9491-da96db335f8f tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 204 len: 0 microversion: 2.1 time: 0.160954 Nov 21 17:18:13.234122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 333/660] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:18:13 2021] DELETE /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 17:18:13.243818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:13.245129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:13.253555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:13.256121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:13.257213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:13.257673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:13.416828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:13.428583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d94f0fe5-71ea-4973-ad3c-c7aa090336a4 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1469 microversion: 2.1 time: 0.189348 Nov 21 17:18:13.429168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 328/661] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:13 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:14.448486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:14.449326 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:14.457513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:14.458219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:14.459119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:14.459801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:14.620404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:14.631943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8d6aa927-22fb-4bf1-826a-8425aeb200db tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1469 microversion: 2.1 time: 0.188553 Nov 21 17:18:14.632934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 334/662] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:14 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:14.900781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:14.902099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:14.908452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:14.909136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:14.909909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:14.910345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:14.943261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fe849486-e2b8-4adb-821d-be8f4ccdf084 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments/5fd6c5aa-9b27-4fcc-8d3b-6af09dac1fb6" status: 200 len: 194 microversion: 2.20 time: 0.046843 Nov 21 17:18:14.951487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 329/663] 10.222.0.52 () {60 vars in 1453 bytes} [Sun Nov 21 17:18:14 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments/5fd6c5aa-9b27-4fcc-8d3b-6af09dac1fb6 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:18:15.043511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:15.043993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:15.050594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.051128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.052053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.052580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.164388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lazy-loading 'services' on Instance uuid 9a72ec97-159e-42a7-b4d8-b10ea675fb22 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:18:15.241384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-73122d3c-90f4-4aa5-a11b-eaeb1a17fbb2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments/5fd6c5aa-9b27-4fcc-8d3b-6af09dac1fb6" status: 202 len: 0 microversion: 2.20 time: 0.203816 Nov 21 17:18:15.242048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 335/664] 10.222.0.52 () {60 vars in 1456 bytes} [Sun Nov 21 17:18:15 2021] DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments/5fd6c5aa-9b27-4fcc-8d3b-6af09dac1fb6 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:18:15.250386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:15.251446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:15.257539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.257985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.259311 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.259772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.294796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f311f0fa-fc04-4398-bab7-18277c129a00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047173 Nov 21 17:18:15.295594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 330/665] 10.222.0.52 () {60 vars in 1342 bytes} [Sun Nov 21 17:18:15 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:18:15.345277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-749a6a87-1f0f-4633-9069-aa2049967c36 req-5bca44d5-bf04-4001-bc7a-555de3d47113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0b5fe0-3814-4c88-8f12-f97169aabda3", "name": "network-vif-deleted", "tag": "fa9451c8-0ff0-4845-b11b-3163537f65f0"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:15.347277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:15.347277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:15.355478 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-749a6a87-1f0f-4633-9069-aa2049967c36 req-5bca44d5-bf04-4001-bc7a-555de3d47113 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.355919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-749a6a87-1f0f-4633-9069-aa2049967c36 req-5bca44d5-bf04-4001-bc7a-555de3d47113 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.368149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-749a6a87-1f0f-4633-9069-aa2049967c36 req-5bca44d5-bf04-4001-bc7a-555de3d47113 service nova] Creating event network-vif-deleted:fa9451c8-0ff0-4845-b11b-3163537f65f0 for instance 8a0b5fe0-3814-4c88-8f12-f97169aabda3 on hv-cinder-81869 Nov 21 17:18:15.373803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-749a6a87-1f0f-4633-9069-aa2049967c36 req-5bca44d5-bf04-4001-bc7a-555de3d47113 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Nov 21 17:18:15.374394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 336/666] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:18:15.659185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:15.659886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:15.667004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.667532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.668331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.668772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.702958 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:15.704335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:15.704866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lazy-loading 'fault' on Instance uuid 8a0b5fe0-3814-4c88-8f12-f97169aabda3 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:18:15.768114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e686687921104d0dad016ef7d97031dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da08c51551493d88ab327519e5853a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:15.776920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6d4472cc-e12e-459e-ae2a-ff8bd7295cc1 tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 200 len: 1304 microversion: 2.1 time: 0.121544 Nov 21 17:18:15.777737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 331/667] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:15 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:16.307535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:16.308411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:16.315051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:16.315540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:16.316497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:16.316973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:16.352547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-600b02d4-fec3-42e2-a214-a82557d8bba9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049944 Nov 21 17:18:16.353278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 337/668] 10.222.0.52 () {60 vars in 1342 bytes} [Sun Nov 21 17:18:16 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:18:16.796123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:16.796779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] [instance: 8a0b5fe0-3814-4c88-8f12-f97169aabda3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:16.803170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:16.803625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:16.804396 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:16.804827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:16.821029 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] HTTP exception thrown: Instance 8a0b5fe0-3814-4c88-8f12-f97169aabda3 could not be found. Nov 21 17:18:16.822215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] Returning 404 to user: Instance 8a0b5fe0-3814-4c88-8f12-f97169aabda3 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:18:16.823190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6d6c1199-e8fc-4915-a38f-1fb21597a4dd tempest-VolumesNegativeTest-1840523052 tempest-VolumesNegativeTest-1840523052-project] 10.222.0.52 "GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3" status: 404 len: 111 microversion: 2.1 time: 0.031039 Nov 21 17:18:16.823767 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 332/669] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:16 2021] GET /compute/v2.1/servers/8a0b5fe0-3814-4c88-8f12-f97169aabda3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:18:17.365701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:17.367179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:17.374493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.374975 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.376555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.376985 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.411295 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-29a53702-48b6-44a8-8ef1-ff20b11830d9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049307 Nov 21 17:18:17.412127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 338/670] 10.222.0.52 () {60 vars in 1342 bytes} [Sun Nov 21 17:18:17 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:17.521875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:17.523004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:17.532586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.533468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.534694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.535690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.582048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:18:17.687138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b90d5733-43d2-4813-84ce-ba33bde5d9c9 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 204 len: 0 microversion: 2.20 time: 0.168769 Nov 21 17:18:17.688099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 333/671] 10.222.0.52 () {60 vars in 1279 bytes} [Sun Nov 21 17:18:17 2021] DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 21 17:18:17.697118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:17.697855 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:17.707225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.707686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.708448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:17.708876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:17.854647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:17.869392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:17.872535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:17.874862 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-48e6d3ca-b7d1-40a9-879f-7b9b0c177dc5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.181636 Nov 21 17:18:17.875556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 339/672] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:17 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:18.895095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:18.895900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:18.902821 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:18.903196 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:18.903896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:18.904426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:19.048495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:19.057158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:19.058937 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:19.060127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5639fe4e-6efc-4e66-95b7-35982019a338 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.169443 Nov 21 17:18:19.060690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 334/673] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:18 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:20.079535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:20.080424 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:20.087576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:20.088112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:20.088970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:20.089474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:20.537322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:20.545915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:20.547650 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:20.549201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c4120cdc-93ba-4c8a-869d-0117ce1b3d03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1724 microversion: 2.20 time: 0.473929 Nov 21 17:18:20.549846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 340/674] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:20 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:21.017127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-c9150cf5-9361-410d-a1a7-f0b8efcb6a3a req-3054790e-b6b1-480a-b0e7-f4f00f500ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ec97-159e-42a7-b4d8-b10ea675fb22", "name": "network-vif-deleted", "tag": "1442537e-27ca-44cc-8ffb-89a41e8c9f57"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:21.019123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:21.019123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:18:21.040672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-c9150cf5-9361-410d-a1a7-f0b8efcb6a3a req-3054790e-b6b1-480a-b0e7-f4f00f500ca6 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:21.042442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-c9150cf5-9361-410d-a1a7-f0b8efcb6a3a req-3054790e-b6b1-480a-b0e7-f4f00f500ca6 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:21.077157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-c9150cf5-9361-410d-a1a7-f0b8efcb6a3a req-3054790e-b6b1-480a-b0e7-f4f00f500ca6 service nova] Creating event network-vif-deleted:1442537e-27ca-44cc-8ffb-89a41e8c9f57 for instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 on hv-cinder-81869 Nov 21 17:18:21.116967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-c9150cf5-9361-410d-a1a7-f0b8efcb6a3a req-3054790e-b6b1-480a-b0e7-f4f00f500ca6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073977 Nov 21 17:18:21.118694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 335/675] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:21.576494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:21.577305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:21.590704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:21.592116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:21.595301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:21.596680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:21.694300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:21.699901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:21.699901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lazy-loading 'fault' on Instance uuid 9a72ec97-159e-42a7-b4d8-b10ea675fb22 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:18:21.802117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:21.831723 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:21.839630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:21.841507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a6f7bb94-dd94-44d9-b779-e0f5cc994e4f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 200 len: 1371 microversion: 2.20 time: 0.270895 Nov 21 17:18:21.844168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 341/676] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:21 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:22.886114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:22.907571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:22.925094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:22.925534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:22.932440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:22.933161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:22.961740 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. Nov 21 17:18:22.968652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:18:22.969780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b25470ce-4a31-454d-afe4-e47703b003b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 404 len: 111 microversion: 2.20 time: 0.102773 Nov 21 17:18:22.970883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 336/677] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:22 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 21 17:18:22.982448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3595ee5e-4686-427a-9b6b-6a1dd5bf2780 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '.version_select at 0x7f1fbe0e4e50>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:23.069634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3595ee5e-4686-427a-9b6b-6a1dd5bf2780 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582424479" status: 204 len: 0 microversion: 2.20 time: 0.091912 Nov 21 17:18:23.070297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 342/678] 10.222.0.52 () {60 vars in 1258 bytes} [Sun Nov 21 17:18:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582424479 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 17:18:24.115463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'create', calling method: .version_select at 0x7f1fbdafd0d0>, body: {"keypair": {"name": "tempest-keypair-423750793"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:24.147613 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:24.156519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:24.538258 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:24.543487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:24.565541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3d4a961e-eab2-407c-9850-1991c2dae8b1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.457387 Nov 21 17:18:24.577002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 337/679] 10.222.0.52 () {62 vars in 1198 bytes} [Sun Nov 21 17:18:24 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 470 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 21 17:18:26.364444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1275448335", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "networks": [{"uuid": "888463c0-5369-453d-9606-a82e43d9d826"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:26.475041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] validate_networks() for [('888463c0-5369-453d-9606-a82e43d9d826', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:18:26.611245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-219108015", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc231359-b800-4314-9a90-40584942a625"}], "security_groups": [{"name": "tempest-securitygroup--1140026178"}], "key_name": "tempest-keypair-423750793", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:26.834894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.network.neutron [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] validate_networks() for [('fc231359-b800-4314-9a90-40584942a625', None, None, None, None, None)] {{(pid=115854) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:18:27.163480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:18:27.174090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:18:27.174090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:18:27.174090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:18:27.174090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:18:27.194763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:27.196349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:27.198306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:27.200047 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:27.243876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Getting quotas for project 80ddce0d66654838a91b9d32226dcaf2. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:27.252443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Getting quotas for user 200cbc1416db4298a26d49d43be6b2a1 and project 80ddce0d66654838a91b9d32226dcaf2. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:27.275411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:18:27.278846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:18:27.378639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6805bf0f-239f-4333-aa0b-e64137342684 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022023 Nov 21 17:18:27.379824 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 343/680] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:18:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:18:27.404878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ada40866-c0d6-4001-902c-601c11018ddc tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:27.405957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ada40866-c0d6-4001-902c-601c11018ddc tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:27.562667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ada40866-c0d6-4001-902c-601c11018ddc tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:27.580627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ada40866-c0d6-4001-902c-601c11018ddc tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1219 microversion: 2.1 time: 0.182507 Nov 21 17:18:27.581853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 344/681] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:27 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:27.613891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Flavor limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:18:27.613891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Image limits 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:18:27.614893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Flavor pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:18:27.615243 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Image pref 0:0:0 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:18:27.615762 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.virt.hardware [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:18:27.626074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:27.626757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:27.628105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:27.628654 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:27.649527 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:27.654274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Getting quotas for user 157b3c042cc5472480ed78415048c756 and project ea840f1e2fe94ebdadee6455cf668d99. Resources: {'cores', 'ram', 'instances'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:27.670416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Going to run 1 instances... {{(pid=115854) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:18:27.674172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:18:27.788283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e514ce78-0a7c-4a93-8e49-e1c3412289e6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.181028 Nov 21 17:18:27.793926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 338/682] 10.222.0.52 () {62 vars in 1187 bytes} [Sun Nov 21 17:18:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 21 17:18:27.807368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:27.808542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:27.916032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:27.924874 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:27.927717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:27.929276 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e548981d-4c9b-4fb3-aa90-da710e422dae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1280 microversion: 2.20 time: 0.127875 Nov 21 17:18:27.930191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 345/683] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:27 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:28.607650 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:28.609189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:28.622607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:28.624332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:28.625801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:28.626607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:28.741040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:28.756662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ec18167d-fc0f-40ed-a488-0cca183b7271 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1271 microversion: 2.1 time: 0.154919 Nov 21 17:18:28.757707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 339/684] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:28 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:28.954011 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:28.955961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:28.965370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:28.966184 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:28.967320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:28.968007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:29.156900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:29.167282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:29.170403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:29.172376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f66c556e-b810-4c34-878c-fa7c933459ca tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1332 microversion: 2.20 time: 0.226692 Nov 21 17:18:29.175646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 346/685] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:28 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1332 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:29.784625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:29.785630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:29.804049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:29.805778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:29.808108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:29.808871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:29.967960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:29.982648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d0d72072-5d2b-4342-8ec3-d91edf214318 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1277 microversion: 2.1 time: 0.204616 Nov 21 17:18:29.986057 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 340/686] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:29 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:30.201970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:30.204709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:30.218142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:30.219528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:30.221070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:30.222451 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:30.528079 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:30.540260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:30.542476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:30.543976 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d4ef4243-23c4-4669-a957-2104b7ba16f0 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.350427 Nov 21 17:18:30.556683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 347/687] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:30 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:31.008756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:31.009887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:31.033880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:31.034557 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:31.035587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:31.036316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:31.255160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-d9ec69bd-f106-4ca5-8f44-5704ee948e7a req-b87e0eaf-cd28-4927-9245-475c03228c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04b8ac9-3c74-4720-9ee3-03113212ad92", "tag": "53c311bf-339e-4705-b6f4-56ccfbfdc9e3"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:31.256918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:31.256918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:31.280767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-d9ec69bd-f106-4ca5-8f44-5704ee948e7a req-b87e0eaf-cd28-4927-9245-475c03228c15 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:31.281421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-d9ec69bd-f106-4ca5-8f44-5704ee948e7a req-b87e0eaf-cd28-4927-9245-475c03228c15 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:31.301378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-d9ec69bd-f106-4ca5-8f44-5704ee948e7a req-b87e0eaf-cd28-4927-9245-475c03228c15 service nova] Creating event network-changed:53c311bf-339e-4705-b6f4-56ccfbfdc9e3 for instance d04b8ac9-3c74-4720-9ee3-03113212ad92 on hv-cinder-81869 Nov 21 17:18:31.308371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-d9ec69bd-f106-4ca5-8f44-5704ee948e7a req-b87e0eaf-cd28-4927-9245-475c03228c15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056672 Nov 21 17:18:31.309770 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 348/688] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:31.373739 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:31.395927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e0c23b1c-319a-4dc1-ac69-3930edb578fd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.395785 Nov 21 17:18:31.398948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 341/689] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:30 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:31.564674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:31.565438 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:31.577573 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:31.578021 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:31.579093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:31.579525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:32.137977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:32.147622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:32.150667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:32.153538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-92bcc38b-290f-46c2-9a74-2028fec9c906 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.592970 Nov 21 17:18:32.168420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 349/690] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:31 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:32.316325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-d272b52f-de6d-43ba-bc83-06da4fdb3270 req-33c6ca7f-5e6c-4b72-8030-0dcd4114af3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1cec94-c4f2-4f9e-8490-35c03810625f", "tag": "5bc4eaf6-2fdf-4242-aaf4-c743af87c815"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:32.329559 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:32.329559 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:18:32.358067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d272b52f-de6d-43ba-bc83-06da4fdb3270 req-33c6ca7f-5e6c-4b72-8030-0dcd4114af3a service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:32.359737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d272b52f-de6d-43ba-bc83-06da4fdb3270 req-33c6ca7f-5e6c-4b72-8030-0dcd4114af3a service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:32.394199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-d272b52f-de6d-43ba-bc83-06da4fdb3270 req-33c6ca7f-5e6c-4b72-8030-0dcd4114af3a service nova] Creating event network-changed:5bc4eaf6-2fdf-4242-aaf4-c743af87c815 for instance ce1cec94-c4f2-4f9e-8490-35c03810625f on hv-cinder-81869 Nov 21 17:18:32.408529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-d272b52f-de6d-43ba-bc83-06da4fdb3270 req-33c6ca7f-5e6c-4b72-8030-0dcd4114af3a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099171 Nov 21 17:18:32.410039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 342/691] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:32.417940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:32.418846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:32.433372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:32.436359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:32.437761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:32.438431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:32.750116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:32.765385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-93b6587d-57c6-4ece-81c1-a4ec707b6010 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.351351 Nov 21 17:18:32.767523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 350/692] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:32 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:33.183960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:33.185775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:33.193178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:33.193884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:33.194903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:33.195502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:33.514521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:33.529372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:33.541245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:33.542494 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b9557081-3b59-44a9-bfbb-48b10b7b76aa tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.369226 Nov 21 17:18:33.543568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 343/693] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:33 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:33.786374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:33.787172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:33.797796 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:33.799885 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:33.800724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:33.801176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:34.149226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:34.188836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c52ce68b-a63d-4eff-a609-b6ad25ccd929 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.405089 Nov 21 17:18:34.192677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 351/694] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:33 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:34.574550 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:34.576020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:34.583014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:34.583861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:34.584742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:34.585442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:34.761949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:34.773370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:34.775948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:34.777404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-eb2bbdbf-0c5a-4096-b5dc-fce47505c071 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.206892 Nov 21 17:18:34.778091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 344/695] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:34 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:18:35.220033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:35.222736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:35.231604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:35.232386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:35.233412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:35.234010 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:35.464375 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:35.476366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f8e327ca-620e-4696-af5d-8ad418b6d5c9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.270594 Nov 21 17:18:35.478226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 352/696] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:35 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:35.799653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:35.800759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:35.813901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:35.814817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:35.816197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:35.817080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:36.082986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:36.111868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:36.115384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:36.117721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-602d0736-1a5e-4437-8238-5901d6e32122 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.324166 Nov 21 17:18:36.119577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 345/697] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:35 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:36.498936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:36.500105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:36.511905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:36.512703 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:36.514509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:36.515662 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:36.744491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:36.759704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6690148b-0695-4b78-a9b1-1fc94a00fef0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.266598 Nov 21 17:18:36.762237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 353/698] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:36 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:37.142339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:37.143604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:37.151917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:37.152699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:37.153787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:37.154875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:37.348373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:37.365068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:37.366751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:37.368459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-95c0cd53-5b01-4893-88e4-18917f04d6a2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.231058 Nov 21 17:18:37.369576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 346/699] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:37 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:37.779644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:37.780556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:37.788788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:37.790072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:37.791351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:37.791786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:38.016623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:38.026052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e83955ff-ebc8-40df-a050-cdecd98bf4ee tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.250157 Nov 21 17:18:38.026662 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 354/700] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:37 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:38.393681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:38.395253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:38.405108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:38.405108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:38.405108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:38.405956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:38.757296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:38.766070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:38.768104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:38.781984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e85323d4-3f5f-4a27-a0b1-550bc56c24ad tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.393581 Nov 21 17:18:38.782935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 347/701] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:38 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:39.044778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:39.049857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:39.058788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:39.059377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:39.060398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:39.061058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:39.306670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:39.315446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-04abd521-2809-42f9-ac83-311ea3cb5e30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.274290 Nov 21 17:18:39.326890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 355/702] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:39 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:39.490461 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-da5ee72b-0315-40b0-b16f-04e58a49fbbd req-e8d3cea5-830f-468b-b15b-10b39ded6b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04b8ac9-3c74-4720-9ee3-03113212ad92", "name": "network-vif-plugged", "status": "completed", "tag": "53c311bf-339e-4705-b6f4-56ccfbfdc9e3"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:39.496921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:39.496921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:18:39.506206 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-da5ee72b-0315-40b0-b16f-04e58a49fbbd req-e8d3cea5-830f-468b-b15b-10b39ded6b48 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:39.506609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-da5ee72b-0315-40b0-b16f-04e58a49fbbd req-e8d3cea5-830f-468b-b15b-10b39ded6b48 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:39.537067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-da5ee72b-0315-40b0-b16f-04e58a49fbbd req-e8d3cea5-830f-468b-b15b-10b39ded6b48 service nova] Creating event network-vif-plugged:53c311bf-339e-4705-b6f4-56ccfbfdc9e3 for instance d04b8ac9-3c74-4720-9ee3-03113212ad92 on hv-cinder-81869 Nov 21 17:18:39.566870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-da5ee72b-0315-40b0-b16f-04e58a49fbbd req-e8d3cea5-830f-468b-b15b-10b39ded6b48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064529 Nov 21 17:18:39.583446 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 348/703] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:18:39.808149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:39.808574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:39.818240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:39.822933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:39.825673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:39.829436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:40.232830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:40.257121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:40.280354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:40.282895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-69180b5e-d0d7-44de-bcc7-b7cc3d7a543b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.479363 Nov 21 17:18:40.286742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 356/704] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:39 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:40.340021 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:40.341748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:40.354237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:40.362967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:40.364485 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:40.365317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:40.857860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:40.858566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:40.871439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:40.872178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:40.873324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:40.873909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:41.038529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:41.047996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-02dfdaf0-b726-45fe-bcad-583b41e0ea7d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1319 microversion: 2.1 time: 0.716461 Nov 21 17:18:41.050844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lazy-loading 'services' on Instance uuid a2b914fc-c9f9-436e-9895-ca4fd17481c4 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:18:41.055333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 349/705] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:40 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1319 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:41.272037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4ddec5d1-623d-4017-ab98-9c5b1d3505f7 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments/1c55d0a1-200c-42ff-8f17-9d372f0c97cc" status: 202 len: 0 microversion: 2.1 time: 0.417641 Nov 21 17:18:41.277038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 357/706] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:18:40 2021] DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments/1c55d0a1-200c-42ff-8f17-9d372f0c97cc => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:18:41.324020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:41.325741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:41.371043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:41.373202 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:41.376748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:41.377400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:41.739055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-56e5890d-7eba-444b-8133-07228d22a63b req-f4d8c5c0-8ed6-44ed-b72d-9e763f73c221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1cec94-c4f2-4f9e-8490-35c03810625f", "name": "network-vif-plugged", "status": "completed", "tag": "5bc4eaf6-2fdf-4242-aaf4-c743af87c815"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:41.741250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:41.741637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:41.741637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:41.762565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-56e5890d-7eba-444b-8133-07228d22a63b req-f4d8c5c0-8ed6-44ed-b72d-9e763f73c221 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:41.764519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-56e5890d-7eba-444b-8133-07228d22a63b req-f4d8c5c0-8ed6-44ed-b72d-9e763f73c221 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:41.765190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:41.767349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:41.793695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-75540cca-4646-4c5e-8700-1f32a2ecc262 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.464423 Nov 21 17:18:41.808833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-56e5890d-7eba-444b-8133-07228d22a63b req-f4d8c5c0-8ed6-44ed-b72d-9e763f73c221 service nova] Creating event network-vif-plugged:5bc4eaf6-2fdf-4242-aaf4-c743af87c815 for instance ce1cec94-c4f2-4f9e-8490-35c03810625f on hv-cinder-81869 Nov 21 17:18:41.819353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 350/707] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:41 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:41.821648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-56e5890d-7eba-444b-8133-07228d22a63b req-f4d8c5c0-8ed6-44ed-b72d-9e763f73c221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Nov 21 17:18:41.823825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 358/708] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:18:42.065538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:42.066359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:42.077873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.090930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.091963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.092422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.314301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:42.327735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-82c12eb9-4db8-47e0-8928-1fca16368946 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1508 microversion: 2.1 time: 0.265877 Nov 21 17:18:42.328351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 351/709] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:42 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:42.614480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ef0a1959-4a7d-4a4d-ae56-759d42248ff8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:42.643929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef0a1959-4a7d-4a4d-ae56-759d42248ff8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.644613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef0a1959-4a7d-4a4d-ae56-759d42248ff8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.732413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ef0a1959-4a7d-4a4d-ae56-759d42248ff8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Going to try to stop instance {{(pid=115853) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 21 17:18:42.810592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ef0a1959-4a7d-4a4d-ae56-759d42248ff8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 202 len: 0 microversion: 2.1 time: 0.207220 Nov 21 17:18:42.812363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 359/710] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:18:42 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:18:42.821765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:42.822533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:42.830006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.831907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.833314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.834371 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.840801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:42.842795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:42.855237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.855693 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:42.859875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:42.860337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:43.127449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:43.135839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-443e5360-afe3-440f-9b91-f3a8be8d9987 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.318188 Nov 21 17:18:43.136935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 352/711] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:42 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:43.159298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:43.168373 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:43.169897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:43.171384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-145d4f51-5515-41cd-9883-6849974aa0a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1406 microversion: 2.20 time: 0.344710 Nov 21 17:18:43.172336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 360/712] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:42 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:44.159605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:44.161927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:44.174259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.175535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.177234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.178311 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.189394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:44.190267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:44.205131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.205584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.206603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.207238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.455583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:44.465362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0f529dd0-c573-43dc-855d-388d8607a06c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.312829 Nov 21 17:18:44.466243 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 353/713] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:44 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:44.487749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:44.497443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:44.499130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:44.500407 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-936efe45-1e56-4259-95a6-581b1e848f18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1599 microversion: 2.20 time: 0.314953 Nov 21 17:18:44.501060 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 361/714] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:18:44 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1599 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 21 17:18:44.520994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:44.521495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:44.528172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.528922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.529701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:44.530299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:44.661844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f03e9213-b8e3-4f28-b482-94282e0d6be5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.144302 Nov 21 17:18:44.663076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 362/715] 10.222.0.52 () {60 vars in 1315 bytes} [Sun Nov 21 17:18:44 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:18:44.696750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Action: 'create', calling method: .version_select at 0x7f1fbd8edee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1014011852"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:44.726399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:44.734416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for user 97f9e20e2721402ab9c1d38e3920f362 and project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:45.152131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:18:45.158119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for user 97f9e20e2721402ab9c1d38e3920f362 and project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:18:45.177383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b15f1c9f-4c01-4fe3-aa09-64be7fe033bf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.709800 Nov 21 17:18:45.183699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 354/716] 10.222.0.52 () {60 vars in 1157 bytes} [Sun Nov 21 17:18:44 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:45.484536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:45.485405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:45.492002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:45.492611 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:45.493493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:45.494194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:45.806421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:45.824066 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e9ac0f2d-0c94-48ed-a65a-c649103e8d53 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.343058 Nov 21 17:18:45.825193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 363/717] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:45 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:46.278296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:46.279628 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:46.281659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-e7e32b05-ea8d-4f43-875c-42f5d3a4bd07 req-1fdefee3-bc9c-436c-af6d-c989f8cbaff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1cec94-c4f2-4f9e-8490-35c03810625f", "tag": "5bc4eaf6-2fdf-4242-aaf4-c743af87c815"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:46.283267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:18:46.283267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:18:46.286292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:46.286773 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:46.287741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:46.288322 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:46.290507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-e7e32b05-ea8d-4f43-875c-42f5d3a4bd07 req-1fdefee3-bc9c-436c-af6d-c989f8cbaff7 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:46.291183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-e7e32b05-ea8d-4f43-875c-42f5d3a4bd07 req-1fdefee3-bc9c-436c-af6d-c989f8cbaff7 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:46.318747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-e7e32b05-ea8d-4f43-875c-42f5d3a4bd07 req-1fdefee3-bc9c-436c-af6d-c989f8cbaff7 service nova] Creating event network-changed:5bc4eaf6-2fdf-4242-aaf4-c743af87c815 for instance ce1cec94-c4f2-4f9e-8490-35c03810625f on hv-cinder-81869 Nov 21 17:18:46.325514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-e7e32b05-ea8d-4f43-875c-42f5d3a4bd07 req-1fdefee3-bc9c-436c-af6d-c989f8cbaff7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047488 Nov 21 17:18:46.326344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 364/718] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:18:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:18:46.376745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5019fb9d-62e2-4c78-b2a7-9375d2dc4a0d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.103001 Nov 21 17:18:46.378142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 355/719] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:46 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:46.871864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:46.873740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:46.882979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:46.883951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:46.885647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:46.887115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:47.155612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:47.172044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-de86e3a5-2d0b-4c07-8e67-a6bc337377ad tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.332253 Nov 21 17:18:47.173104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 365/720] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:46 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:47.400533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:47.403887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:47.411394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:47.412214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:47.413220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:47.414693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:47.481053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-162cbf79-bedd-4e3a-95ee-2e05a5edd563 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.096760 Nov 21 17:18:47.483221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 356/721] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:47 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:48.190514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:48.191238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:48.199306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:48.199956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:48.200752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:48.201375 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:48.338029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:48.350059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3e2d9fa1-24a5-4ab0-859e-b5ae2992d835 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.160891 Nov 21 17:18:48.350059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 366/722] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:48 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:48.494461 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:48.496825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:48.508426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:48.508765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:48.509738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:48.510170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:48.574291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b25d777b-70ac-4cc1-a9df-0543a4646fd6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.085041 Nov 21 17:18:48.575285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 357/723] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:48 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:49.366259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:49.367480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:49.373302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:49.373755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:49.374515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:49.374978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:49.515345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:49.522541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5627b336-3d48-493c-9b2b-c3a2fbd447b6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.159949 Nov 21 17:18:49.523134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 367/724] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:49 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:49.588176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:49.589276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:49.595830 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:49.596275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:49.597050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:49.597484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:49.665659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f5824dcf-4ac0-4c3e-8fc9-8c4b979e1163 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.081939 Nov 21 17:18:49.666441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 358/725] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:49 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:50.540358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:50.540989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:50.547032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:50.547481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:50.548261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:50.548691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:50.677929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:50.679138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:50.685736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:50.688318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:50.688794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:50.689691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:50.690213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:50.699318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5574358b-ac78-437f-8403-6ea98b71865c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.162733 Nov 21 17:18:50.699903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 368/726] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:50 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:50.766280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-155a954e-e065-47c3-9dc5-0b675371ee3c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.092495 Nov 21 17:18:50.768068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 359/727] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:50 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:51.717246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:51.717856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:51.724525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:51.726248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:51.727126 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:51.727561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:51.778355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:51.779995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:51.787367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:51.788250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:51.790013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:51.791560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:51.867824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9508e3f4-a98a-45cc-96b9-0daa627fb55d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.086870 Nov 21 17:18:51.867824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 360/728] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:51 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:51.868025 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:51.871453 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8582b3e2-cd89-4365-aebc-ad456fcf6600 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.157883 Nov 21 17:18:51.872023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 369/729] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:51 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:52.872919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:52.874610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:52.882326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:52.882837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:52.883620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:52.884542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:52.889009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:52.889617 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:52.896172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:52.896892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:52.897663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:52.898271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:52.947593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-83850394-b60f-4298-9f3e-d966714f382f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.078239 Nov 21 17:18:52.948291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 361/730] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:52 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:53.028813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:53.036464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f48ad423-0a04-43f7-916f-97687cd15c3a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1676 microversion: 2.1 time: 0.151138 Nov 21 17:18:53.037031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 370/731] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:52 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:53.959568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:53.961079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:53.969621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:53.970367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:53.971301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:53.971834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.039529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ef2118a8-eeb9-4112-b03b-101eb6515165 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.083917 Nov 21 17:18:54.040953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 362/732] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:53 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:54.054989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:54.056216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:54.063486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:54.063997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.064917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:54.065450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.203156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:54.211151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c8fa30f7-0e6d-4614-9770-9ea142419cf8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1653 microversion: 2.1 time: 0.161134 Nov 21 17:18:54.211919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 371/733] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:54 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1653 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:54.229942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8dbacc5f-c25c-4a4d-8de7-733c3b3de895 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:54.237137 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8dbacc5f-c25c-4a4d-8de7-733c3b3de895 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:54.237642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8dbacc5f-c25c-4a4d-8de7-733c3b3de895 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.263179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8dbacc5f-c25c-4a4d-8de7-733c3b3de895 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Going to try to start instance {{(pid=115854) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 21 17:18:54.311817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8dbacc5f-c25c-4a4d-8de7-733c3b3de895 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action" status: 202 len: 0 microversion: 2.1 time: 0.086189 Nov 21 17:18:54.312619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 363/734] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:18:54 2021] POST /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:18:54.322686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:54.323360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:54.333179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:54.333749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.334559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:54.335072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:54.494209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:54.501719 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7130cb00-2612-488f-b7fd-4d6f47338132 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1662 microversion: 2.1 time: 0.184594 Nov 21 17:18:54.502295 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 372/735] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:54 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:55.053900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:55.054951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:55.061234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:55.061827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:55.062764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:55.063078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:55.126322 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c37c3a43-dcee-4878-bce6-ee8f28890d11 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.076038 Nov 21 17:18:55.127005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 364/736] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:55 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:55.521031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:55.521644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:55.528065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:55.528518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:55.529294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:55.529735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:55.662018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:55.670258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-90598cf4-eaa1-48e4-9b54-2bd10f4463f1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1662 microversion: 2.1 time: 0.153574 Nov 21 17:18:55.670871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 373/737] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:55 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:56.137994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:56.138935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:56.145530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:56.145979 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:56.146780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:56.147217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:56.221246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6fdf9abc-3da5-4518-9ad0-79d8a145ce22 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.087258 Nov 21 17:18:56.222031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 365/738] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:56 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:56.687463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:18:56.688093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:56.693880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:56.694331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:56.695125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:56.695561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:56.831920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:18:56.840024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-be22a1cc-210f-42ba-bd87-bffe17ebb8cf tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1666 microversion: 2.1 time: 0.156256 Nov 21 17:18:56.840596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 374/739] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:18:56 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:18:57.233615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:57.234520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:57.241028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:57.241477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:57.242237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:57.242708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:57.305847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-75f99dd9-a384-4060-842a-b896dc769b84 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 14 microversion: 2.20 time: 0.076144 Nov 21 17:18:57.306587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 366/740] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:57 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:18:58.316621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:58.317528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:58.324032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:58.324477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:58.325239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:58.325669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:58.410589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-65a8b723-442d-4066-8036-54bb942a3698 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 8354 microversion: 2.20 time: 0.097459 Nov 21 17:18:58.411281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 375/741] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:58 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 8354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:18:59.423667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:18:59.424709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:18:59.431646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:59.432087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:59.432846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:18:59.433268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:18:59.511628 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-858d3767-f950-4de4-a7e4-3b9de3d2a29f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 15025 microversion: 2.20 time: 0.092267 Nov 21 17:18:59.512544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 367/742] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:18:59 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 15025 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:00.523613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:00.524613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:00.531200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:00.531649 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:00.532407 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:00.532840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:00.604561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-72c74196-cf0a-4358-a3eb-5aa93f0278ce tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 18056 microversion: 2.20 time: 0.084900 Nov 21 17:19:00.605198 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 376/743] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:00 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 18056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:01.616692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:01.617611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:01.624125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:01.624574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:01.625334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:01.625770 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:01.705771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dfe2f5f2-18cd-43e3-bab1-03d4b770f476 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 19096 microversion: 2.20 time: 0.093115 Nov 21 17:19:01.706401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 368/744] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:01 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 19096 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:02.717083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:02.718093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:02.725007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:02.725452 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:02.726224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:02.726679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:02.801663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a337a30a-5707-4c2e-ad15-9bba36f6ca03 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 21165 microversion: 2.20 time: 0.088627 Nov 21 17:19:02.802592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 377/745] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:02 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 21165 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:03.815248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:03.816302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:03.823033 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:03.823584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:03.824359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:03.824782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:03.898142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0534beb1-d547-4ee4-9bec-4aa7074d864f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 22767 microversion: 2.20 time: 0.086778 Nov 21 17:19:03.898142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 369/746] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:03 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 22767 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:04.909464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:04.910486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:04.916844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:04.917985 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:04.918814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:04.919242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:04.994381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e2631f00-2b6e-4e9a-afca-afec9f74413c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 23671 microversion: 2.20 time: 0.088718 Nov 21 17:19:04.994973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 378/747] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:04 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 23671 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:06.006778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:06.007687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:06.014845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:06.015294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:06.016064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:06.016504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:06.120916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c96e3249-818b-471e-bd21-e2d4cf4afdd2 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 24499 microversion: 2.20 time: 0.117494 Nov 21 17:19:06.121785 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 370/748] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:06 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 24499 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:07.133196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:07.134188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:07.141382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:07.141832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:07.142646 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:07.143163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:07.227037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-20c5675c-dc2f-43da-b092-80f2c873da9e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 25615 microversion: 2.20 time: 0.097692 Nov 21 17:19:07.227677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 379/749] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:07 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 25615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:07.697543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14347942-f2ef-4720-85fa-00c5f2437784", "device": "/dev/sdb"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:07.699342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:07.706027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:07.706470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:07.707319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:07.707693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:08.159398 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-82705b1d-5936-4525-a906-30498a6a80f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "POST /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465302 Nov 21 17:19:08.160332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 371/750] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:19:07 2021] POST /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:19:08.239007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:08.240013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:08.246777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:08.247296 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:08.248290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:08.248729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:08.335657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-94f3cfea-2058-449e-a85e-0e12dc1997b4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 26593 microversion: 2.20 time: 0.100548 Nov 21 17:19:08.336593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 380/751] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:08 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 26593 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:09.348652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:09.349619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:09.358574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:09.359060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:09.359825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:09.360257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:09.469359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d85e1d3c-acf8-4ca6-bcbf-1e7dafc0932e tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 27176 microversion: 2.20 time: 0.124596 Nov 21 17:19:09.470028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 372/752] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:09 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 27176 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:10.481949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:10.482986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:10.489470 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:10.489911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:10.490712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:10.491147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:10.574492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-38e4e38a-6046-4fc2-9933-408c006a1c18 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 27645 microversion: 2.20 time: 0.095721 Nov 21 17:19:10.575119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 381/753] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:10 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 27645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:11.587686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:11.589429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:11.596315 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:11.596678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:11.597445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:11.597869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:11.677623 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0f8b4e91-3b3b-489c-981c-5bdfb07c4d64 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28032 microversion: 2.20 time: 0.093801 Nov 21 17:19:11.678295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 373/754] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:11 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28032 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:11.721819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1044896946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1014011852", "security_groups": [{"name": "tempest-secgroup-smoke-1022196311"}], "networks": [{"uuid": "20d92de2-82a0-4dc9-a3ae-8b3c4a3f3124"}], "block_device_mapping_v2": [{"uuid": "4b0687fc-3070-4033-8a6d-dbb8e642808b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:11.879644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] validate_networks() for [('20d92de2-82a0-4dc9-a3ae-8b3c4a3f3124', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:19:12.237246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:19:12.237676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:19:12.238149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:19:12.238556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:19:12.239002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:19:12.248181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:12.248629 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:12.249467 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:12.249928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:12.267630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:19:12.272176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Getting quotas for user 97f9e20e2721402ab9c1d38e3920f362 and project b1faf1efb9b549ae90cdf14b0e48e7e1. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:19:12.331844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:19:12.334192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b0687fc-3070-4033-8a6d-dbb8e642808b',volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:19:12.458943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-71039bda-82b6-4ad6-8e72-2a08f5c14bd3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741080 Nov 21 17:19:12.459580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 382/755] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:19:11 2021] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:19:12.469898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e78d3de4-a32e-4754-8092-c350c4eec9ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:12.470794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e78d3de4-a32e-4754-8092-c350c4eec9ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:12.524738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e78d3de4-a32e-4754-8092-c350c4eec9ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:12.531510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e78d3de4-a32e-4754-8092-c350c4eec9ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1089 microversion: 2.1 time: 0.065675 Nov 21 17:19:12.532077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 374/756] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:12.690335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:12.691387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:12.698583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:12.699169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:12.700197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:12.701722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:12.796910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f0e7f625-40d5-4398-9620-326651f5ea80 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28173 microversion: 2.20 time: 0.109586 Nov 21 17:19:12.801525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 383/757] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:12 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28173 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:13.550660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:13.551373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:13.559150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:13.559673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:13.561190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:13.561682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:13.624358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:13.631869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8ef4b7a2-b392-4c00-b99c-20f05b699089 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1205 microversion: 2.1 time: 0.085989 Nov 21 17:19:13.632677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 375/758] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:13.813320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:13.814391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:13.820941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:13.821393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:13.822172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:13.822605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:13.892881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e88fb304-8bab-4a0d-acc7-9c92bbac49d8 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28173 microversion: 2.20 time: 0.083351 Nov 21 17:19:13.893971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 384/759] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:13 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28173 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:14.649205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:14.649810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:14.656788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:14.659048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:14.661132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:14.661757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:14.880268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:14.889070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-61cfcc5f-896e-4549-a7de-24fd4a453592 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1273 microversion: 2.1 time: 0.242670 Nov 21 17:19:14.889780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 376/760] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:14.905821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:14.906852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:14.914306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:14.914789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:14.915557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:14.915986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:15.015785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3cd5d5d1-ce36-4eb1-8835-1af8b7c71e00 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28456 microversion: 2.20 time: 0.113805 Nov 21 17:19:15.016409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 385/761] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:14 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28456 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:15.261440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-317f3473-5b37-4c2b-a350-d1149ff376a3 req-da2c4e95-bf15-425e-8389-c4ae4f2e8594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:15.271392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:19:15.271392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:19:15.281107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-317f3473-5b37-4c2b-a350-d1149ff376a3 req-da2c4e95-bf15-425e-8389-c4ae4f2e8594 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:15.282359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-317f3473-5b37-4c2b-a350-d1149ff376a3 req-da2c4e95-bf15-425e-8389-c4ae4f2e8594 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:15.297358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-317f3473-5b37-4c2b-a350-d1149ff376a3 req-da2c4e95-bf15-425e-8389-c4ae4f2e8594 service nova] Creating event network-changed:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:19:15.303352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-317f3473-5b37-4c2b-a350-d1149ff376a3 req-da2c4e95-bf15-425e-8389-c4ae4f2e8594 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044661 Nov 21 17:19:15.304294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 377/762] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:19:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:19:15.906291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:15.907100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:15.913684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:15.914231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:15.915134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:15.915624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:16.028126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:16.029229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:16.035719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:16.036168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:16.036940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:16.037380 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:16.119317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:16.129448 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9743e5e8-f566-40fd-896a-928eef15fa8b tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28624 microversion: 2.20 time: 0.105109 Nov 21 17:19:16.129595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a88fc4fa-e448-4426-aeb2-6128f37d5c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.227872 Nov 21 17:19:16.130107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 386/763] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:16.131109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 378/764] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:16 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:17.147552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:17.148253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:17.154973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:17.155423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:17.156197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:17.156638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:17.252360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:17.253269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:17.259661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:17.260114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:17.260882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:17.261314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:17.291587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:17.299389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b3c48f63-0524-46be-95ae-fc48a3b85acf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.155994 Nov 21 17:19:17.299955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 379/765] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:17.332135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2d15a859-d638-4c07-a09e-8a987483855d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28624 microversion: 2.20 time: 0.193584 Nov 21 17:19:17.332742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 387/766] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:17 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28624 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:18.316705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:18.317241 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:18.323616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:18.324060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:18.324827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:18.325260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:18.344088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:18.345720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:18.356013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:18.357238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:18.358460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:18.359205 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:18.433289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-af793e60-14a8-467b-80ad-e96bc9136f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28624 microversion: 2.20 time: 0.093478 Nov 21 17:19:18.433939 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 388/767] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:18 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28624 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:18.459712 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:18.467568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bd4e4104-f45b-4742-945c-7992b429fb34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.154638 Nov 21 17:19:18.468131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 380/768] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:19.445538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:19.446529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:19.454447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:19.455033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:19.456114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:19.456707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:19.484734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:19.486050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:19.492383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:19.492827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:19.493583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:19.494012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:19.529868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ff17864a-d8f0-4f54-8621-ea57d05fc8a4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 28624 microversion: 2.20 time: 0.087748 Nov 21 17:19:19.530569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 389/769] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:19 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 28624 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:19.617609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:19.626105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a7249e63-fe68-4785-bb72-aecdf4fb40a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.145234 Nov 21 17:19:19.626694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 381/770] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:20.542477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:20.543507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:20.550076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:20.550609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:20.551398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:20.551833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:20.643416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:20.644027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:20.644157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2324218b-135b-4ef3-b81c-770cec668cb5 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 29434 microversion: 2.20 time: 0.105623 Nov 21 17:19:20.646673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 390/771] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:20 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 29434 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:20.650373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:20.650867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:20.651639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:20.652074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:20.775507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:20.783086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-28d83c67-4386-42f4-b145-3be407144ff2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.143294 Nov 21 17:19:20.783651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 382/772] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:21.656498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:21.657498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:21.664165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:21.664609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:21.665378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:21.665809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:21.745709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-09d5ed36-7e16-4e46-a077-96e470821d48 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 31252 microversion: 2.20 time: 0.093274 Nov 21 17:19:21.746390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 391/773] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:21 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 31252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:21.800742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:21.801352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:21.807303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:21.807755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:21.808515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:21.808949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:21.927487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:21.934723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1d7b859e-11f2-474d-8fd3-643c18dcf948 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.137622 Nov 21 17:19:21.935856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 383/774] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:22.758568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:22.759578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:22.766745 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:22.767187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:22.767955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:22.768384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:22.849022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f4cf0623-7964-4f08-933f-7815ee87c9ab tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 32865 microversion: 2.20 time: 0.094489 Nov 21 17:19:22.849695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 392/775] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:22 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 32865 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:22.952555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:22.953182 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:22.959250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:22.959727 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:22.960482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:22.960911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:23.084036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:23.092400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2efc180f-1689-46a1-9b42-d8e3087b5d64 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.144110 Nov 21 17:19:23.092988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 384/776] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:23.862361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:23.863330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:23.869775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:23.870206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:23.870995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:23.871419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:23.953364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a8611057-a6b0-4565-9b50-e3a8dc1b10dd tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 33679 microversion: 2.20 time: 0.095726 Nov 21 17:19:23.954229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 393/777] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:23 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 33679 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 21 17:19:24.109139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:24.109716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:24.115810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:24.116193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:24.116944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:24.117366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:24.241127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:24.248419 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f23ea1e-6242-47ff-b9d1-bfc57743014e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.143039 Nov 21 17:19:24.248985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 385/778] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:24.965979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:24.967002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:24.973459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:24.973899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:24.974678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:24.975115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:25.052237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6ec5dcc4-0401-40ec-9b68-af241a1f103f tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 34692 microversion: 2.20 time: 0.090091 Nov 21 17:19:25.053100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 394/779] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:24 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 34692 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:25.265221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:25.265983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:25.272502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:25.272957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:25.273723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:25.274157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:25.392897 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:25.400536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e1a7e3aa-1171-43a0-a9b4-299a8b973dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.139142 Nov 21 17:19:25.401107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 386/780] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:26.065295 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:26.066269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:26.072647 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:26.073088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:26.073840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:26.074267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:26.155888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f1efd963-1ffa-44d9-889a-5daa6c863746 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 35746 microversion: 2.20 time: 0.094599 Nov 21 17:19:26.158568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 395/781] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:26 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 35746 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:26.417141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:26.417730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:26.424365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:26.424815 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:26.425572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:26.426007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:26.551913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:26.559384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-212d84b7-541c-4f77-8c53-c1d4c7867d28 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.145911 Nov 21 17:19:26.559953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 387/782] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:27.168006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:27.169008 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:27.175800 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:27.176252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:27.177053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:27.177487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:27.252685 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-62c8fd44-56bc-4b7b-8386-1cb3c80b19cb tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 37182 microversion: 2.20 time: 0.088506 Nov 21 17:19:27.253337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 396/783] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:27 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 37182 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:27.577143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:27.577880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:27.583963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:27.584400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:27.585150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:27.585581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:27.710213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:27.717405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ec75fa87-12bc-4be8-b7f2-be62a4fa1165 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.144032 Nov 21 17:19:27.718532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 388/784] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:28.265691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:28.266262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:28.273803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:28.274235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:28.275043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:28.275466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:28.353554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-41e5e2de-1c92-4562-87d4-04d8426c3484 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 38165 microversion: 2.20 time: 0.092660 Nov 21 17:19:28.357747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 397/785] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:28 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 38165 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:28.736944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:28.737675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:28.744087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:28.744600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:28.745630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:28.746069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:28.896352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:28.906634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4fef1e22-c3fb-4def-9086-ae69b19a6b49 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.175121 Nov 21 17:19:28.907649 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 389/786] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:29.366210 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:29.367251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:29.373826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:29.374916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:29.375690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:29.376145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:29.441041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-05799765-ba4a-431f-ba14-009df8a96fe4 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 38165 microversion: 2.20 time: 0.078639 Nov 21 17:19:29.441865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 398/787] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:29 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 38165 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:29.927097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:29.927707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:29.933540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:29.933988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:29.934784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:29.935268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:30.053859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:30.061180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-57187aaf-bbb7-4046-9177-5aa9556639e6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.137969 Nov 21 17:19:30.062023 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 390/788] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:30.458320 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:30.460029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:30.469507 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:30.469957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:30.470817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:30.471256 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:30.549580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b4a92b05-728e-48fe-9587-9db00d87ecc7 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 38165 microversion: 2.20 time: 0.099935 Nov 21 17:19:30.550240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 399/789] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:30 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 38165 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:31.080982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:31.080982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:31.085067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:31.085523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:31.086296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:31.086761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:31.210924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:31.218709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-addf1203-f902-427a-9f34-61752ee6c39a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.143513 Nov 21 17:19:31.219303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 391/790] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:31.562064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:31.562849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:31.569332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:31.569773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:31.570534 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:31.570998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:31.656537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7a713342-fd44-4270-bdb0-4903f82d4f4c tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 38171 microversion: 2.20 time: 0.097923 Nov 21 17:19:31.657220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 400/791] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:31 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 38171 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:32.235640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:32.236266 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:32.242138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.242589 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.243385 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.243817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.362957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:32.370123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3140eea2-df63-4581-932e-b884f9d5e763 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.138778 Nov 21 17:19:32.370711 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 392/792] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:32.668525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:19:32.669585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:32.676521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.676968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.677733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.678160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.758914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4021c685-c609-453d-a45b-cb7ddbbfa227 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action" status: 200 len: 38306 microversion: 2.20 time: 0.094267 Nov 21 17:19:32.759569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 401/793] 10.222.0.52 () {62 vars in 1318 bytes} [Sun Nov 21 17:19:32 2021] POST /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/action => generated 38306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:19:32.771060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:32.771562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:32.777403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.777858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.778640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:32.779079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:32.803281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a26ebb69-a0cc-49fe-b84f-0023287980b6 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/ips" status: 200 len: 152 microversion: 2.20 time: 0.035839 Nov 21 17:19:32.803859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 393/794] 10.222.0.52 () {60 vars in 1288 bytes} [Sun Nov 21 17:19:32 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:19:33.387816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:33.388510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:33.394938 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:33.395391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:33.396157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:33.396588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:33.515244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:33.522410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-edbe0317-4eee-4634-9c6a-86eb9ce30fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.138586 Nov 21 17:19:33.523014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 402/795] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:34.539643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:34.540244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:34.546709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:34.547158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:34.547953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:34.548384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:34.678351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:34.685587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-024b4920-cd14-4d7c-8b23-78aca32a9a43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.149634 Nov 21 17:19:34.686143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 394/796] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:35.702098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:35.702815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:35.709453 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:35.709898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:35.710669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:35.711098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:35.838357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:35.846360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0b8efee8-5fb7-45a6-9fb3-5d71928083cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.147892 Nov 21 17:19:35.846974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 403/797] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:36.862690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:36.863305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:36.869029 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:36.869472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:36.870215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:36.870655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:36.991789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:36.999265 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9a82adbe-c850-41b9-b987-eca48b05519f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.140312 Nov 21 17:19:36.999902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 395/798] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:38.017349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:38.017913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:38.024362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:38.024813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:38.025588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:38.026029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:38.151248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:38.159159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4060b0a1-791b-4bc6-9a62-7de96792154c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.145816 Nov 21 17:19:38.159725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 404/799] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:39.176056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:39.176670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:39.182391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:39.182867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:39.183615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:39.184041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:39.304797 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:39.312095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-529e84f9-7296-4ca9-8215-616da1f2dde3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.139643 Nov 21 17:19:39.312659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 396/800] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:40.329619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:40.330229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:40.335932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:40.336376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:40.337119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:40.337542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:40.457286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:40.464543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-01155cce-c60e-4337-a0ab-306f117f2542 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.139045 Nov 21 17:19:40.465108 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 405/801] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:41.482928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:41.484067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:41.490047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:41.490496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:41.491331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:41.491767 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:41.617382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:41.625218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-53394ec4-6947-474e-9a2f-10fc6fdbd0d7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.147814 Nov 21 17:19:41.625795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 397/802] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:42.643259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:42.643852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:42.650310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:42.650794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:42.651576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:42.652005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:42.776093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:42.783759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-33f6fcf4-ebad-4af7-9b3a-fad5fde186a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.145505 Nov 21 17:19:42.784522 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 406/803] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:43.801116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:43.801736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:43.807862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:43.808313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:43.809097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:43.809544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:43.954123 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:43.961742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8975e0d0-a846-4fa1-8281-e8551b17d32f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.164577 Nov 21 17:19:43.962320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 398/804] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:44.985454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:44.986085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:44.992187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:44.992642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:44.993421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:44.993861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:45.134933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:45.143349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-85403dfe-1a7d-4f0e-a02b-34c9816d165c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.161952 Nov 21 17:19:45.143942 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 407/805] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:46.163779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:46.164857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:46.175424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:46.176025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:46.176923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:46.177452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:46.360664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:46.368640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ae111946-9234-4e7d-93e4-8ea776dd6264 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.211078 Nov 21 17:19:46.369336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 399/806] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:47.385882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:47.386476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:47.394454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:47.395298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:47.396215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:47.396693 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:47.537160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:47.545901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9994244a-793d-40ba-a065-1f5815903b7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.163498 Nov 21 17:19:47.546471 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 408/807] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:48.566838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:48.567741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:48.573998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:48.574443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:48.575250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:48.575683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:48.722982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:48.730496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2546ff8e-3178-4de8-aefe-99aeec88d705 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.169964 Nov 21 17:19:48.731119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 400/808] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:49.758605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:49.759794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:49.768140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:49.768595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:49.769382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:49.769820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:49.924734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:49.932799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-19763b26-084a-41e1-916b-020b748181c5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.179903 Nov 21 17:19:49.933386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 409/809] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:50.950993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:50.952118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:50.959725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:50.960219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:50.961012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:50.961453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:51.104201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:51.113854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-445d6e8e-bae0-4959-9553-ec1960e34708 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.166552 Nov 21 17:19:51.114453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 401/810] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:52.131663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:52.132537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:52.138935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:52.140023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:52.140804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:52.141239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:52.280427 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:52.288513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-22ea5cbe-4e30-459c-82ad-0e9c8753a827 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.160640 Nov 21 17:19:52.289099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 410/811] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:53.306584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:53.307259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:53.314040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:53.314515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:53.315316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:53.315752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:53.454218 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:53.463007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0a626396-c26e-4699-9969-f827a2a87001 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.160061 Nov 21 17:19:53.463600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 402/812] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:54.481830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:54.482460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:54.489351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:54.489808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:54.490608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:54.491090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:54.627345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:54.636162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0cfa3b10-284b-46a7-8201-938bd6febf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.158067 Nov 21 17:19:54.636789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 411/813] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:55.652562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:55.653159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:55.659949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:55.660397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:55.661187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:55.661617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:55.795742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:55.803286 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0f1dec3c-33af-40ee-83f2-0cde22013614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.154422 Nov 21 17:19:55.803863 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 403/814] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:56.820797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:56.821404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:56.827552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:56.828063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:56.829173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:56.829620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:56.956677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:56.964060 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ee611db6-6b11-4c05-9aae-4a0382574a79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.147000 Nov 21 17:19:56.964619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 412/815] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:19:57.982183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:57.983521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:57.989602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:57.990052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:57.990857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:57.991296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:58.119071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:58.127176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5b12864e-8ccc-4549-831f-02cf6e3957ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.148604 Nov 21 17:19:58.127755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 404/816] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:19:59.144325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:19:59.144915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:19:59.151516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:59.151971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:59.152742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:19:59.153176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:19:59.292457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:19:59.306699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d8d46d0c-be0a-4449-bee8-0c21acd1c21b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.165652 Nov 21 17:19:59.307779 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 413/817] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:19:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:00.049299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:00.050227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:00.056273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.056721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.057523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.057968 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.089059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0653805a-08ee-4b42-8f4a-eb29ba64d5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043892 Nov 21 17:20:00.089646 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 405/818] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:20:00 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:00.152153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:00.152764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:00.159623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.160074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.160848 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.161277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.187388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:20:00.276039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7f62e760-05bd-4c80-a9f4-636ce5518816 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 204 len: 0 microversion: 2.1 time: 0.126525 Nov 21 17:20:00.276989 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 414/819] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:20:00 2021] DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:20:00.287417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:00.288220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:00.296048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.296405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.297035 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.297472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.345540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:00.347005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:00.356257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.356811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.357593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:00.358031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:00.488510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:00.509306 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-355519bc-24c6-4320-9cec-744678ffcd9f tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1672 microversion: 2.1 time: 0.226176 Nov 21 17:20:00.510605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 406/820] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:00 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:00.569215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:00.579879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3b9b226b-327a-4a61-aa86-72a5136fc851 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.243338 Nov 21 17:20:00.580621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 415/821] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:01.536079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:01.536695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:01.543256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:01.543798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:01.544681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:01.545394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:01.598729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:01.599590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:01.608829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:01.610389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:01.611822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:01.612648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:01.735408 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:01.745581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2532454a-9125-4189-9722-acb011df3b2d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1672 microversion: 2.1 time: 0.213347 Nov 21 17:20:01.746201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 407/822] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:01 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1672 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:01.798554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:01.806250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-16f9593f-0155-4eb2-aea9-3d25d6419dd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.211202 Nov 21 17:20:01.806887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 416/823] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:02.764877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:02.765624 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:02.771989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:02.772437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:02.773216 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:02.773651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:02.831630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:02.833189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:02.843486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:02.844249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:02.845895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:02.846705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:03.063277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:03.071791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7e3d7849-bac8-4409-b98c-7c9d32e335fd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1672 microversion: 2.1 time: 0.311277 Nov 21 17:20:03.084005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 408/824] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:02 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1672 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:03.168480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:03.182476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1383a025-f716-45d1-98c4-3a44f0f4c067 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.358134 Nov 21 17:20:03.183607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 417/825] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:03.767770 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-a4a09adc-8199-4c83-8a94-0fb3e8a90848 req-b3656acf-bce0-4f89-b3d3-dd3f9e3b342e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b914fc-c9f9-436e-9895-ca4fd17481c4", "name": "network-vif-deleted", "tag": "858ad848-0f28-45d6-9e17-0e58fd716a04"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:03.772409 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:03.772409 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:20:03.787538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a4a09adc-8199-4c83-8a94-0fb3e8a90848 req-b3656acf-bce0-4f89-b3d3-dd3f9e3b342e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:03.788951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-a4a09adc-8199-4c83-8a94-0fb3e8a90848 req-b3656acf-bce0-4f89-b3d3-dd3f9e3b342e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:03.814928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-a4a09adc-8199-4c83-8a94-0fb3e8a90848 req-b3656acf-bce0-4f89-b3d3-dd3f9e3b342e service nova] Creating event network-vif-deleted:858ad848-0f28-45d6-9e17-0e58fd716a04 for instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 on hv-cinder-81869 Nov 21 17:20:03.825252 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-a4a09adc-8199-4c83-8a94-0fb3e8a90848 req-b3656acf-bce0-4f89-b3d3-dd3f9e3b342e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164588 Nov 21 17:20:03.832175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 409/826] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:20:04.091698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:04.093176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:04.099551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:04.100031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:04.100850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:04.101265 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:04.142450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:04.142941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:04.143400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lazy-loading 'fault' on Instance uuid a2b914fc-c9f9-436e-9895-ca4fd17481c4 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:20:04.189769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:04.197748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a838ef61-8e52-4db2-8bd0-69eba49046a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 200 len: 1326 microversion: 2.1 time: 0.109550 Nov 21 17:20:04.210330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 418/827] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:04 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:04.212001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:04.212241 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:04.226342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:04.227160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:04.228848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:04.229611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:04.442050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:04.450039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-37939748-b4f4-4fde-91c5-5ad81bad127e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.247394 Nov 21 17:20:04.450691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 410/828] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:05.222935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:05.223741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:05.231233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:05.231678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:05.232968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:05.233401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:05.248733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. Nov 21 17:20:05.249490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:20:05.250428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2911dd01-d438-4785-a7aa-c3ef39e12a8d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 404 len: 111 microversion: 2.1 time: 0.031408 Nov 21 17:20:05.251049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 419/829] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:05 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:20:05.259681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9a3de3dd-40ad-4c42-a195-7a09a2c180fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '.version_select at 0x7f1fbd85bee0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:05.281584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9a3de3dd-40ad-4c42-a195-7a09a2c180fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317306131" status: 202 len: 0 microversion: 2.1 time: 0.025499 Nov 21 17:20:05.282228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 411/830] 10.222.0.52 () {58 vars in 1217 bytes} [Sun Nov 21 17:20:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317306131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:20:05.469788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:05.470423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:05.476760 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:05.477584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:05.478498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:05.479058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:05.714556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:05.724598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a42ff035-21c4-4636-9317-b98dbcf265d9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.259127 Nov 21 17:20:05.725357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 420/831] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:06.236959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'create', calling method: .version_select at 0x7f1fbd8ed040>, body: {"keypair": {"name": "tempest-keypair-1115736544"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:06.270528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:20:06.277919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:20:06.487604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:20:06.494501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:20:06.515809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-249af9a5-a1f2-4f93-adc2-1c60cb4cc5bb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.286264 Nov 21 17:20:06.516435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 412/832] 10.222.0.52 () {60 vars in 1157 bytes} [Sun Nov 21 17:20:06 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:06.746499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:06.748846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:06.756221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:06.756770 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:06.757679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:06.758367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:06.936447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:06.950208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8f79c818-85a3-40e8-b21a-782ba07322c8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.207972 Nov 21 17:20:06.951356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 421/833] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:07.977130 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:07.977979 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:07.989816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:07.990581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:07.991985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:07.992801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:08.082963 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-135547752", "imageRef": "4b700841-7592-4c46-a9b5-4dc0178f1d00", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "081dfc56-aafd-485f-9f9b-45b7fc1568a4"}], "security_groups": [{"name": "tempest-securitygroup--1371788228"}], "key_name": "tempest-keypair-1115736544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:08.177481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:08.185492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5d4ef8f0-4688-46e7-af4a-54826cc1f6e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.215387 Nov 21 17:20:08.186880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 413/834] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:08.228392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] validate_networks() for [('081dfc56-aafd-485f-9f9b-45b7fc1568a4', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:20:08.818664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:20:08.819421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:20:08.820236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:20:08.821275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:20:08.822223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:20:08.838654 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:08.839391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:08.840748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:08.841381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:08.869899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for project ce6ca60f20da438e91d85bcb43057906. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:20:08.875632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Getting quotas for user 0f39e65554e2450f87950fe8645d7fe6 and project ce6ca60f20da438e91d85bcb43057906. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:20:08.889523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:20:08.892523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b700841-7592-4c46-a9b5-4dc0178f1d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:20:08.946281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-30360344-9618-4a17-bb33-10db9e9c4a49 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.872364 Nov 21 17:20:08.946973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 422/835] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:20:08 2021] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 21 17:20:08.958585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1e16b189-ad55-4a66-8e6d-fdd8a7431ac4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:08.959105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1e16b189-ad55-4a66-8e6d-fdd8a7431ac4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:09.021626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1e16b189-ad55-4a66-8e6d-fdd8a7431ac4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:09.030750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1e16b189-ad55-4a66-8e6d-fdd8a7431ac4 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1237 microversion: 2.1 time: 0.076973 Nov 21 17:20:09.031358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 414/836] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:08 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:09.205262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:09.206173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:09.212921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:09.213262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:09.214100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:09.214585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:09.389380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:09.400000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d025f9c2-183e-4592-9a32-c2202c8f970f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.200210 Nov 21 17:20:09.400772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 423/837] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:10.048012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:10.048611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:10.054978 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:10.055573 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:10.056482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:10.057013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:10.121220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:10.129806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4abb4ad3-d565-4b06-9220-f948cd330808 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1241 microversion: 2.1 time: 0.085423 Nov 21 17:20:10.130462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 415/838] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:10 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:10.418334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:10.419098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:10.426259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:10.426736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:10.427531 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:10.428033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:10.592761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:10.601057 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b4e0489b-eae6-4375-a01a-5106a28df057 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.186431 Nov 21 17:20:10.601639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 424/839] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:11.148310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:11.148925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:11.155260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:11.155713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:11.156509 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:11.156949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:11.221775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:11.229629 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9ceb5b8-b2e4-451d-95fd-da564338a143 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1241 microversion: 2.1 time: 0.084986 Nov 21 17:20:11.230212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 416/840] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:11 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:11.618597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:11.619398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:11.628345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:11.628798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:11.629591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:11.630026 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:11.808615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:11.817129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-afe31c48-f9e9-4ba7-b793-baa66e9725a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.202338 Nov 21 17:20:11.817725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 425/841] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:12.251454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:12.253560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:12.265716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:12.266584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:12.268459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:12.269314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:12.348609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:12.356463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3ed2ad02-d89d-409a-8848-963daae1613e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1241 microversion: 2.1 time: 0.111505 Nov 21 17:20:12.357797 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 417/842] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:12 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:12.833874 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:12.834479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:12.840393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:12.840842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:12.842224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:12.842682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:12.961579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:12.970296 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3b54b8c7-984e-45a5-8c47-4c2b9213c2ce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.140032 Nov 21 17:20:12.970901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 426/843] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:13.388312 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:13.389519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:13.396260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:13.396709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:13.397496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:13.400987 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:13.488143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:13.495908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-97f59435-495d-4037-9777-fb57bf075208 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1295 microversion: 2.1 time: 0.111487 Nov 21 17:20:13.496475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 418/844] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:13 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:13.988224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:13.988851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:13.995018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:13.995331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:13.996102 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:13.996531 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:14.236540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:14.248091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-74ee7ae4-5dab-4644-b9de-b25ea78abdab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.263486 Nov 21 17:20:14.249392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 427/845] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:14.515081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:14.515845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:14.531092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:14.531092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:14.531092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:14.531092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:14.726548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:14.739116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e2ea2a0c-d01a-4e5a-8966-dc074518ae91 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.228144 Nov 21 17:20:14.739717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 419/846] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:14 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:20:14.958119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-4c2f5d34-7c0a-410d-a056-af95890292c9 req-02c0aec3-5ee5-495f-be66-279e176ba365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02bcb091-a1a4-40bc-b707-333917982e30", "tag": "2e3d300c-ffeb-467e-a720-8b0afd9b280f"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:14.960360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:14.960360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:20:14.969200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-4c2f5d34-7c0a-410d-a056-af95890292c9 req-02c0aec3-5ee5-495f-be66-279e176ba365 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:14.969634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-4c2f5d34-7c0a-410d-a056-af95890292c9 req-02c0aec3-5ee5-495f-be66-279e176ba365 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:14.981835 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-4c2f5d34-7c0a-410d-a056-af95890292c9 req-02c0aec3-5ee5-495f-be66-279e176ba365 service nova] Creating event network-changed:2e3d300c-ffeb-467e-a720-8b0afd9b280f for instance 02bcb091-a1a4-40bc-b707-333917982e30 on hv-cinder-81869 Nov 21 17:20:14.987430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-4c2f5d34-7c0a-410d-a056-af95890292c9 req-02c0aec3-5ee5-495f-be66-279e176ba365 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033742 Nov 21 17:20:14.988735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 428/847] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:20:15.267293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:15.267293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:15.275146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:15.275612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:15.276738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:15.277340 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:15.477473 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:15.488362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9db42b50-03fe-4990-9267-8bf51af4a631 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.227386 Nov 21 17:20:15.488960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 420/848] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:15.761357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:15.762241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:15.769886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:15.770382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:15.771217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:15.771652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:15.958481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-71dd20e7-1d79-433d-a677-6cc70d62a7c0 req-c21e1efa-5db8-44ba-9516-3c542c50d63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "name": "network-vif-plugged", "status": "completed", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:15.961347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:15.961347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:20:15.973870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-71dd20e7-1d79-433d-a677-6cc70d62a7c0 req-c21e1efa-5db8-44ba-9516-3c542c50d63f service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:15.974515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-71dd20e7-1d79-433d-a677-6cc70d62a7c0 req-c21e1efa-5db8-44ba-9516-3c542c50d63f service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:15.986993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-71dd20e7-1d79-433d-a677-6cc70d62a7c0 req-c21e1efa-5db8-44ba-9516-3c542c50d63f service nova] Creating event network-vif-plugged:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:20:15.992180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-71dd20e7-1d79-433d-a677-6cc70d62a7c0 req-c21e1efa-5db8-44ba-9516-3c542c50d63f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108288 Nov 21 17:20:15.992694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 421/849] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:20:16.031742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:16.039409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0712fc34-f417-47a2-a728-4f8e84975038 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.282342 Nov 21 17:20:16.040317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 429/850] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:15 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:16.506009 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:16.506888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:16.512921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:16.513541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:16.514466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:16.514847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:16.645326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:16.652595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-87fbcde5-c505-47de-a7c6-ca0f214645f5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1261 microversion: 2.1 time: 0.150548 Nov 21 17:20:16.653159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 422/851] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:17.057861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:17.058418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:17.064819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.065260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.066039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.066471 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.199965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:17.208630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-49448f48-fd5c-4717-995e-2bb1f21f8710 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.154465 Nov 21 17:20:17.209247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 430/852] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:17 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:17.669220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:17.670183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:17.676015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.676465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.677237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.677693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.812357 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:17.820116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6109d209-bc37-4b15-a6a3-eff79927da61 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1445 microversion: 2.1 time: 0.154114 Nov 21 17:20:17.820589 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 423/853] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:17.836693 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:17.837294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:17.843683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.844119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.844883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:17.845306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:17.980075 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:17.988745 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-41ff8a60-5c69-4705-8923-2b231449e4fe tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1445 microversion: 2.1 time: 0.155628 Nov 21 17:20:17.989319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 431/854] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:18.228005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:18.228775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:18.235524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:18.235959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:18.236936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:18.237370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:18.379037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:18.390455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-464bcd43-8030-4451-bc66-72c4e57d3b78 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.165646 Nov 21 17:20:18.391535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 424/855] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:18 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:19.414542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:19.415285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:19.421779 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:19.422325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:19.423038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:19.423462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:19.554073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:19.562038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6c229ae7-aa3d-4609-b024-abf1ad3499a5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.151117 Nov 21 17:20:19.562763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 432/856] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:19 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:19.940551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-941f651b-03f3-43ad-a08f-2a0b186d60fa req-ecd31bb6-c266-4d56-aaef-c6ae72b5bc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:19.942438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:19.942438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:20:19.949870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-941f651b-03f3-43ad-a08f-2a0b186d60fa req-ecd31bb6-c266-4d56-aaef-c6ae72b5bc9d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:19.950310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-941f651b-03f3-43ad-a08f-2a0b186d60fa req-ecd31bb6-c266-4d56-aaef-c6ae72b5bc9d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:19.963943 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-941f651b-03f3-43ad-a08f-2a0b186d60fa req-ecd31bb6-c266-4d56-aaef-c6ae72b5bc9d service nova] Creating event network-changed:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:20:19.970303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-941f651b-03f3-43ad-a08f-2a0b186d60fa req-ecd31bb6-c266-4d56-aaef-c6ae72b5bc9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110440 Nov 21 17:20:19.971295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 425/857] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:20:20.044278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-7047fc79-e4b3-463d-bb50-ba965e99f0a9 req-9e89095d-5201-4fbf-8b73-3cff6524598d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bcb091-a1a4-40bc-b707-333917982e30", "name": "network-vif-plugged", "status": "completed", "tag": "2e3d300c-ffeb-467e-a720-8b0afd9b280f"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:20.047255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:20.047255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:20:20.054664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-7047fc79-e4b3-463d-bb50-ba965e99f0a9 req-9e89095d-5201-4fbf-8b73-3cff6524598d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:20.055152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-7047fc79-e4b3-463d-bb50-ba965e99f0a9 req-9e89095d-5201-4fbf-8b73-3cff6524598d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:20.068937 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-7047fc79-e4b3-463d-bb50-ba965e99f0a9 req-9e89095d-5201-4fbf-8b73-3cff6524598d service nova] Creating event network-vif-plugged:2e3d300c-ffeb-467e-a720-8b0afd9b280f for instance 02bcb091-a1a4-40bc-b707-333917982e30 on hv-cinder-81869 Nov 21 17:20:20.075999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-7047fc79-e4b3-463d-bb50-ba965e99f0a9 req-9e89095d-5201-4fbf-8b73-3cff6524598d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Nov 21 17:20:20.077798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 433/858] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:20:20.580642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:20.581357 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:20.587633 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:20.588091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:20.588908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:20.589347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:20.803083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:20.811327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4b79af96-34b9-4f8b-a556-d1fb692fb701 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1363 microversion: 2.1 time: 0.235647 Nov 21 17:20:20.811886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 426/859] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:20 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:21.829471 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:21.830171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:21.836269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:21.836715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:21.837477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:21.837912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:21.964464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:20:21.973023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c1b32cf6-b0a9-4911-af38-6d6aa3cb851e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1548 microversion: 2.1 time: 0.148297 Nov 21 17:20:21.973602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 434/860] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:20:21 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:21.989946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:20:21.990514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:21.996529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:21.996984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:21.997760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:21.998196 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:22.085019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4b7caece-e8f2-49cc-8434-3f948c4324a1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098810 Nov 21 17:20:22.085612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 427/861] 10.222.0.52 () {58 vars in 1274 bytes} [Sun Nov 21 17:20:21 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:20:23.061939 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:23.062494 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-843248b1-c560-49d7-bf47-cd7f273280e9 req-c8abb334-b296-4073-8c2e-04d8f98fb0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02bcb091-a1a4-40bc-b707-333917982e30", "tag": "2e3d300c-ffeb-467e-a720-8b0afd9b280f"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:23.062994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:23.063662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:20:23.063662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:20:23.070532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-843248b1-c560-49d7-bf47-cd7f273280e9 req-c8abb334-b296-4073-8c2e-04d8f98fb0ce service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:23.071000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-843248b1-c560-49d7-bf47-cd7f273280e9 req-c8abb334-b296-4073-8c2e-04d8f98fb0ce service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:23.071157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:23.071632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:23.072573 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:23.073049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:23.083895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-843248b1-c560-49d7-bf47-cd7f273280e9 req-c8abb334-b296-4073-8c2e-04d8f98fb0ce service nova] Creating event network-changed:2e3d300c-ffeb-467e-a720-8b0afd9b280f for instance 02bcb091-a1a4-40bc-b707-333917982e30 on hv-cinder-81869 Nov 21 17:20:23.088179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-843248b1-c560-49d7-bf47-cd7f273280e9 req-c8abb334-b296-4073-8c2e-04d8f98fb0ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Nov 21 17:20:23.089126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 428/862] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:20:23.145861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-87d0aa61-26bf-4760-ad76-62d39c29f475 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.088670 Nov 21 17:20:23.146809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 435/863] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:23 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:24.157741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:24.158762 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:24.164678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:24.165121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:24.165871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:24.166302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:24.232532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-178696cb-366f-4675-8fe7-01d0c78554b3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.078238 Nov 21 17:20:24.233170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 429/864] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:24 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:25.244291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:25.245290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:25.252562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:25.253007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:25.253785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:25.254214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:25.319912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c2bd3b03-2212-4156-8e7d-6b399835878e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.079522 Nov 21 17:20:25.320525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 436/865] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:25 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:26.331450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:26.332439 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:26.339141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:26.339581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:26.340341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:26.340766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:26.402199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-95995dbe-9df3-4a48-a18b-9c3ae2967298 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.074918 Nov 21 17:20:26.402776 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 430/866] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:26 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:27.413463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:27.414384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:27.421086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:27.421541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:27.422401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:27.423102 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:27.487708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ee9546b9-397c-4ec1-a17b-f3d6115558c9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.078190 Nov 21 17:20:27.488496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 437/867] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:27 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:28.500372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:28.501281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:28.507993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:28.508441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:28.509242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:28.509672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:28.574806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e5a1defc-1919-44cc-b893-87ffabee0e10 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.078738 Nov 21 17:20:28.575963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 431/868] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:28 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:29.586759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:29.587760 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:29.594293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:29.594781 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:29.595549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:29.595985 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:29.655067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fa21a6b8-5200-40fb-8863-487c9985b501 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.072160 Nov 21 17:20:29.655689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 438/869] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:29 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:30.666445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:30.667509 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:30.674368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:30.674835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:30.675617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:30.676050 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:30.745580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a1b4b6a5-b133-412d-8d3e-343711feb817 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.083041 Nov 21 17:20:30.746219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 432/870] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:30 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:31.757678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:31.758694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:31.765132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:31.765572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:31.766868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:31.767299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:31.834491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cdea51ae-a2d3-44fc-9920-1e4e73ad54f5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.080604 Nov 21 17:20:31.835203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 439/871] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:31 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:32.846650 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:32.847630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:32.854515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:32.854986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:32.855754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:32.856174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:32.923195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e72bcae9-76e8-45d0-b060-2a0d30f7b511 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 14 microversion: 2.1 time: 0.081101 Nov 21 17:20:32.924224 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 433/872] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:32 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:20:33.934910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:33.935947 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:33.943057 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:33.943510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:33.944283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:33.944717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:34.018721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-31611eca-9c05-4518-8ca8-c1107a3316aa tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 6314 microversion: 2.1 time: 0.087528 Nov 21 17:20:34.019293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 440/873] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:33 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 6314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:20:35.029829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:35.030852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:35.038152 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:35.038605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:35.039405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:35.039837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:35.132891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ba3ac3e1-7a30-429f-92e0-d6224bafc7be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 15025 microversion: 2.1 time: 0.106831 Nov 21 17:20:35.133554 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 434/874] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:35 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 15025 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:36.144966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:36.146032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:36.153050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:36.153497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:36.154268 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:36.154751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:36.232820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5bdea38c-0b91-4c5c-879f-26c4163dd4d3 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 18356 microversion: 2.1 time: 0.091954 Nov 21 17:20:36.233473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 441/875] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:36 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:37.245181 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:37.246182 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:37.252572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:37.253027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:37.253878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:37.254317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:37.330808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7931f70b-74e8-4efa-bc06-a9171e60acfd tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 19342 microversion: 2.1 time: 0.089424 Nov 21 17:20:37.332366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 435/876] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:37 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 19342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 21 17:20:38.343829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:38.344799 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:38.351814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:38.352262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:38.353029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:38.353459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:38.428955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d56073ab-5373-4dd3-acc0-26da01cc6f3d tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 22211 microversion: 2.1 time: 0.088926 Nov 21 17:20:38.429642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 442/877] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:38 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 22211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:39.440141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:39.441034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:39.448024 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:39.448462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:39.449209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:39.449633 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:39.529795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-646f6b0d-af35-41d2-a497-0eca50ee5fe8 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 23728 microversion: 2.1 time: 0.093562 Nov 21 17:20:39.530460 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 436/878] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:39 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 23728 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:40.543029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:40.543947 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:40.550448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:40.550893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:40.551659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:40.552174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:40.631582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f3a5d656-64a0-43fe-b1e9-4dfc24c71d47 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 25045 microversion: 2.1 time: 0.092738 Nov 21 17:20:40.632263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 443/879] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:40 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 25045 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:41.643923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:41.644960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:41.652154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:41.652597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:41.653370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:41.653804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:41.735103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-86031cbb-e9ef-4c5b-b755-9a7450659e42 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 26484 microversion: 2.1 time: 0.095071 Nov 21 17:20:41.736115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 437/880] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:41 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 26484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:42.747206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:42.748233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:42.754828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:42.755896 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:42.756661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:42.757093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:42.835624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-12429dff-505f-4f1c-b74f-3b4cff7e4fa1 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 27478 microversion: 2.1 time: 0.092279 Nov 21 17:20:42.836279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 444/881] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:42 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 27478 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:43.847986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:43.849240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:43.855716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:43.856167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:43.856936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:43.857402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:43.944343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-871c8133-4285-4ae8-9044-8af922702837 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 27896 microversion: 2.1 time: 0.100189 Nov 21 17:20:43.945198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 438/882] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:43 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 27896 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:44.956860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:44.957859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:44.965063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:44.965510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:44.966273 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:44.966747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:45.046293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4eca55d8-4659-4775-852f-ea4bd93e6988 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28206 microversion: 2.1 time: 0.093568 Nov 21 17:20:45.047106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 445/883] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:44 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28206 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:46.118792 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:46.119855 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:46.125765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:46.126207 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:46.127000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:46.127423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:46.199994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ae74b5e-a794-4d7e-9234-2f44b3873c9b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28206 microversion: 2.1 time: 0.145918 Nov 21 17:20:46.200626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 439/884] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:46 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28206 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:47.213030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:47.214033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:47.220640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:47.221080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:47.221837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:47.222261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:47.303283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5aaa8cc2-45f1-42a7-8581-2f9a639e4dbc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28497 microversion: 2.1 time: 0.094593 Nov 21 17:20:47.304000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 446/885] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:47 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28497 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:48.316353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:48.316739 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:48.324622 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:48.325174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:48.325967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:48.326403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:48.406720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2afc3547-812b-4b7c-9575-e04efb1cf845 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28664 microversion: 2.1 time: 0.095793 Nov 21 17:20:48.407379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 440/886] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:48 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28664 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:49.419163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:49.420235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:49.429729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:49.430195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:49.431016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:49.431444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:49.497360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c6d3cddb-4651-4df7-a798-a5f681b97081 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28664 microversion: 2.1 time: 0.082063 Nov 21 17:20:49.497933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 447/887] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:49 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28664 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:50.509988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:50.511048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:50.517525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:50.517966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:50.518803 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:50.519215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:50.587000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1287eb8c-67c6-4032-974d-aa6eafac6d3e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28664 microversion: 2.1 time: 0.080854 Nov 21 17:20:50.587673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 441/888] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:50 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28664 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:51.600608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:51.601510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:51.607891 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:51.608331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:51.609085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:51.609897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:51.673679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1d6c4e37-d049-4c1b-acd2-ed962e5f93f9 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 28664 microversion: 2.1 time: 0.077771 Nov 21 17:20:51.674341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 448/889] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:51 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 28664 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:52.686492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:52.687426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:52.694519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:52.694995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:52.695757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:52.696190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:52.774673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4654f4f9-c650-468d-9854-56c84b947fe2 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 29384 microversion: 2.1 time: 0.092060 Nov 21 17:20:52.775358 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 442/890] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:52 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 29384 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:53.786822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:53.787868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:53.794365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:53.794853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:53.795623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:53.796059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:53.876462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ea7f3270-8ae6-4ac5-8d64-f2b392c1621a tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 31425 microversion: 2.1 time: 0.093640 Nov 21 17:20:53.877094 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 449/891] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:53 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 31425 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:54.888195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:54.889178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:54.895514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:54.895955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:54.897351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:54.897775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:54.971302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ca71138b-59d6-4cbb-b66f-44c86e1bfcce tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 32939 microversion: 2.1 time: 0.086959 Nov 21 17:20:54.971942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 443/892] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:54 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 32939 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:55.983493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:55.984496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:55.991713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:55.992183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:55.992959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:55.993392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:56.068953 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d6d802c6-93e6-457a-a547-766bd1f7b570 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 33706 microversion: 2.1 time: 0.089323 Nov 21 17:20:56.069607 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 450/893] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:55 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 33706 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:57.082713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:57.084175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:57.092169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:57.092620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:57.093435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:57.093873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:57.172957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d5909226-2bc5-40ae-897a-3e3ce0472838 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 34837 microversion: 2.1 time: 0.095121 Nov 21 17:20:57.173602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 444/894] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:57 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 34837 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:58.185582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:58.186597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:58.194122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:58.194716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:58.195497 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:58.195925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:58.278371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fc68ef54-ad02-4b4c-9e31-4f9b34f5bc30 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 35811 microversion: 2.1 time: 0.096565 Nov 21 17:20:58.279059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 451/895] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:58 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 35811 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:20:59.292336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:20:59.293254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:20:59.299986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:59.300434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:59.301707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:20:59.301707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:20:59.384788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0ae766be-50d9-4bda-bc6b-52ae5463b741 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 37367 microversion: 2.1 time: 0.096453 Nov 21 17:20:59.385435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 445/896] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:20:59 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 37367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:00.397988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:21:00.399036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:00.405443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:00.405889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:00.406671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:00.407107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:00.494697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-576f6d21-b6bb-4992-9d78-1e4bfd026370 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 38190 microversion: 2.1 time: 0.101097 Nov 21 17:21:00.495338 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 452/897] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:21:00 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 38190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:01.507789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:21:01.508800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:01.515569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:01.516018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:01.516810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:01.517254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:01.587862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f1679db4-01d2-4cdb-bb06-dc17c833da3b tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 38190 microversion: 2.1 time: 0.085299 Nov 21 17:21:01.588533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 446/898] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:21:01 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 38190 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:02.601486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:21:02.602495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:02.609253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:02.609701 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:02.610486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:02.610948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:02.688000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-181d0418-0014-4368-9a87-ca573e91e51c tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 38190 microversion: 2.1 time: 0.091369 Nov 21 17:21:02.688699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 453/899] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:21:02 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 38190 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:03.706584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:21:03.707658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:03.714686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:03.715142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:03.715927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:03.716368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:03.792575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1092eb84-c5f5-4565-880a-5f1b75c940bc tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 38190 microversion: 2.1 time: 0.090118 Nov 21 17:21:03.793226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 447/900] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:21:03 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 38190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:04.805219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:21:04.806226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:04.812707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:04.813156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:04.813920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:04.814355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:04.906949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-53d89a40-2b63-460b-a1e6-b8cefb6929fb tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action" status: 200 len: 38319 microversion: 2.1 time: 0.105865 Nov 21 17:21:04.907600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 454/901] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:21:04 2021] POST /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/action => generated 38319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 21 17:21:04.918113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:21:04.918716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:21:04.925229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:04.925679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:04.926452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:21:04.926917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:21:04.951688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-025c1434-a1ef-4349-93c7-c3c693ba4113 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/ips" status: 200 len: 144 microversion: 2.1 time: 0.037491 Nov 21 17:21:04.952272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 448/902] 10.222.0.52 () {58 vars in 1247 bytes} [Sun Nov 21 17:21:04 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:21:43.040303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:21:43.040900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:21:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:22:18.016532 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:22:18.017194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:18.024565 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:18.025262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:18.025939 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:18.026410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:18.049409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lazy-loading 'flavor' on Instance uuid 62b0ec33-1901-4e36-b169-9f396631f2b1 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:22:18.122651 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-99405b4a-7b07-4ecb-be66-df2df3cacb79 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "POST /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1/action" status: 202 len: 0 microversion: 2.1 time: 0.111197 Nov 21 17:22:18.123263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 455/903] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:22:18 2021] POST /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:22:18.133395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:18.134049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:18.140765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:18.141217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:18.142075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:18.142441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:18.283564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:18.291990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-177ff28f-3a27-4251-bd4d-5bb893f06b11 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.163529 Nov 21 17:22:18.292564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 449/904] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:19.310909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:19.311516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:19.317791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:19.318312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:19.319099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:19.319570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:19.447381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:19.454971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-03198997-67b0-4db6-b53c-3e63db5f58dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.148277 Nov 21 17:22:19.455541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 456/905] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:20.472290 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:20.472974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:20.480005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:20.480453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:20.481327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:20.481665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:20.618925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:20.626309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a780e9f5-5ae4-419f-a6b5-3d938f1e91a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.157757 Nov 21 17:22:20.626909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 450/906] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:21.644174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:21.644761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:21.651158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:21.651610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:21.652377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:21.652839 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:21.777669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:21.784911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-777364f3-04d9-4d55-90a9-3ce73d2c10a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144374 Nov 21 17:22:21.785477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 457/907] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:22.802186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:22.802813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:22.809691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:22.810132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:22.810902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:22.811329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:22.935691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:22.942962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6dd95020-d187-4c06-8581-c2969e7f54a6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144390 Nov 21 17:22:22.943532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 451/908] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:23.960636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:23.961995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:23.968247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:23.968678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:23.969523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:23.969943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:24.103105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:24.110683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2459d673-41b7-41d4-87e4-3bdfbc5c6bea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.153909 Nov 21 17:22:24.111336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 458/909] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:22:25.127864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:25.128471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:25.134879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:25.135355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:25.136113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:25.136544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:25.255693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:25.263351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3c367630-1c6a-44c3-8019-f002dd5c8329 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139121 Nov 21 17:22:25.263922 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 452/910] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:26.280606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:26.281213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:26.288127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:26.288582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:26.289468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:26.289930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:26.425369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:26.433641 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e4fcb3d3-a256-48ec-bc81-a7c57f136fad tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.156629 Nov 21 17:22:26.434221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 459/911] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:27.451994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:27.452607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:27.459734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:27.461636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:27.462057 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:27.462293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:27.589459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:27.596933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dc7c7dde-13d1-4159-b42a-fc80a512aeb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.149510 Nov 21 17:22:27.597491 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 453/912] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:28.612748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:28.613369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:28.619357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:28.619810 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:28.620580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:28.621014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:28.815251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:28.822811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5920b621-00f0-473f-88d6-89c19dcb9f46 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.213612 Nov 21 17:22:28.823405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 460/913] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:29.839886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:29.840507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:29.846428 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:29.846914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:29.847686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:29.848116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:29.971655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:29.980151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-58a90baa-8dfe-4dcc-8305-9ad585971c63 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144044 Nov 21 17:22:29.980709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 454/914] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:22:30.997186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:30.997795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:31.003727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:31.004180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:31.004937 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:31.005375 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:31.130394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:31.140968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-033f600d-d797-4240-b8fd-d2e6676047cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.147478 Nov 21 17:22:31.141552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 461/915] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:32.158326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:32.159008 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:32.165746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:32.166186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:32.167045 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:32.167467 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:32.285710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:32.293200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-82ef865a-3c77-4bbb-afc4-257986372d0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138644 Nov 21 17:22:32.293755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 455/916] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:33.313530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:33.315000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:33.322164 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:33.322615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:33.323414 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:33.323851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:33.448367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:33.456193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8533e56a-7bbc-4e05-94fe-6ea61354c38c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.148939 Nov 21 17:22:33.456750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 462/917] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:34.476002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:34.477028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:34.487638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:34.488538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:34.489921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:34.490784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:34.559543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-2a84e350-ec6a-4e4b-9479-a6890066f5af req-1aa7f090-2d16-4015-918c-00eae1e9df8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:22:34.561388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:22:34.561388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:22:34.571302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-2a84e350-ec6a-4e4b-9479-a6890066f5af req-1aa7f090-2d16-4015-918c-00eae1e9df8d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:34.571715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-2a84e350-ec6a-4e4b-9479-a6890066f5af req-1aa7f090-2d16-4015-918c-00eae1e9df8d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:34.583871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-2a84e350-ec6a-4e4b-9479-a6890066f5af req-1aa7f090-2d16-4015-918c-00eae1e9df8d service nova] Creating event network-vif-unplugged:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:22:34.589772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-2a84e350-ec6a-4e4b-9479-a6890066f5af req-1aa7f090-2d16-4015-918c-00eae1e9df8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034197 Nov 21 17:22:34.591127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 463/918] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:22:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:22:34.652865 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:34.660404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-566ae1fe-6a7c-4ccb-bb7c-1738d3b7aa74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.190312 Nov 21 17:22:34.660967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 456/919] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:22:35.677420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:35.678115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:35.684727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:35.685180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:35.685958 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:35.686390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:35.814488 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:35.822908 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-12f08920-22e7-483c-ae16-80f66d00efce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.149487 Nov 21 17:22:35.823463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 464/920] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:36.840986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:36.841775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:36.847698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:36.848149 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:36.848920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:36.849347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:36.977434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:36.984829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-295c4fda-f842-45a9-adbb-7642e2488d09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.147485 Nov 21 17:22:36.985402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 457/921] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:37.146200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:22:37.146844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:22:37.238042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:22:37.238273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:22:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:22:38.002733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:38.003381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:38.009887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:38.010317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:38.011127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:38.011592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:38.145337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:38.154111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-095dfef3-e4b6-4df8-b510-61a8f5fdc91c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.155023 Nov 21 17:22:38.154805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 465/922] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:39.171996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:39.172601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:39.178703 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:39.179156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:39.179955 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:39.180422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:39.310364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:39.317854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9307d737-667b-43c0-b6ee-4eadd6e4f680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.149550 Nov 21 17:22:39.318418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 458/923] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:40.334887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:40.335499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:40.343374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:40.343819 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:40.344592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:40.345023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:40.469271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:40.476955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b1fcc7af-009c-4b74-aa04-a10b33776bfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145695 Nov 21 17:22:40.477583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 466/924] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:41.496160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:41.496690 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:41.502854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:41.503309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:41.504105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:41.504540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:41.627649 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:41.635537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0f294534-15cc-48ec-b655-4c8478d03d0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144879 Nov 21 17:22:41.636098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 459/925] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:42.652738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:42.653350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:42.659158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:42.659594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:42.660335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:42.660759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:42.784229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:42.792096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9b1b9074-2fc3-4cdf-bbcf-3c6b9984d121 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.143182 Nov 21 17:22:42.792661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 467/926] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:22:43.808959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:43.809647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:43.815459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:43.815909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:43.816668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:43.817105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:43.936216 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:43.943431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-877f7b2e-7cb1-4c00-ac8a-2d37cc3bcb9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138712 Nov 21 17:22:43.943984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 460/927] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:44.960658 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:44.962124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:44.968054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:44.968518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:44.969264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:44.969699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:45.093247 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:45.100469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3591c4e7-2e04-4f5d-a049-39dd3a45aa31 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.143557 Nov 21 17:22:45.101037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 468/928] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:46.118602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:46.119267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:46.125229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:46.125676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:46.126458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:46.126926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:46.249747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:46.258768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d34fcae9-7b8c-4973-878d-b44d2af5c36e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.143386 Nov 21 17:22:46.259445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 461/929] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:47.277361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:47.277973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:47.283671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:47.284127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:47.284866 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:47.285291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:47.405446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:47.412737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f553a35a-79d0-429e-a4ca-be811202697c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139570 Nov 21 17:22:47.413299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 469/930] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:48.430948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:48.431780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:48.439362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:48.439962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:48.441037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:48.441617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:48.566958 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:48.575186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a867d4ad-e8e9-4481-8050-392c35cd5361 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.148170 Nov 21 17:22:48.575505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 462/931] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:49.592372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:49.592995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:49.598665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:49.599121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:49.599888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:49.600318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:49.725357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:49.733724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8d263035-f0ad-4f6f-bdae-e0304dd42f7c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144882 Nov 21 17:22:49.734315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 470/932] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:50.751148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:50.751754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:50.757619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:50.758063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:50.758866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:50.759911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:50.885659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:50.893207 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7414a90b-3fa9-499c-9808-37a5b9568d69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145681 Nov 21 17:22:50.893791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 463/933] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:51.910854 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:51.911457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:51.917827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:51.918311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:51.919147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:51.919615 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:52.044887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:52.052257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-04bfb53f-338a-4121-9075-9d21bf1c967f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145198 Nov 21 17:22:52.052828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 471/934] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:53.069679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:53.070236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:53.076315 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:53.076783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:53.077584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:53.078018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:53.198083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:53.205601 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e5bc2edb-33a2-4ef0-9f98-a9b65b375bb4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139696 Nov 21 17:22:53.206159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 464/935] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:54.222642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:54.223363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:54.229541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:54.229990 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:54.230783 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:54.231215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:54.349974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:54.358067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-899cf246-117e-49f3-96b6-3a9da1be9b90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139057 Nov 21 17:22:54.358640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 472/936] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:22:55.375528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:55.376173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:55.382141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:55.382587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:55.383366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:55.383795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:55.509160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:55.516909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5eed2e47-c5ff-4e76-8795-9a8ae32a14b9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145237 Nov 21 17:22:55.517460 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 465/937] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:56.534558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:56.535191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:56.541042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:56.541490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:56.542258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:56.542723 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:56.669309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:56.676748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4f782202-0ff6-49fe-9fe6-b45b7d9af16b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145868 Nov 21 17:22:56.677309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 473/938] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:57.693856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:57.694413 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:57.701847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:57.702296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:57.703190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:57.703628 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:57.827203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:57.834904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dd11e37d-a4a3-47ae-a747-dc4c7d113782 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144714 Nov 21 17:22:57.835478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 466/939] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:22:58.854841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:22:58.855574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:22:58.861959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:58.862408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:58.863213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:22:58.863694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:22:58.989704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:22:58.997419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1e72d3f6-e844-4d2b-aa2a-703d2330fe4c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.146980 Nov 21 17:22:58.997992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 474/940] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:22:58 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:00.015507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:00.016103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:00.022320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:00.022817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:00.023701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:00.024049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:00.162794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:00.170292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-94f07ea6-a38c-4073-a517-3dbb87e6613c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.159280 Nov 21 17:23:00.170892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 467/941] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:01.187388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:01.188037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:01.193681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:01.194145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:01.195020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:01.195461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:01.314009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:01.321207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ce73a9d5-db9d-45e5-bec5-fca9c1cf1476 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137352 Nov 21 17:23:01.321762 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 475/942] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:02.343484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:02.344116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:02.349974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:02.350414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:02.351219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:02.351648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:02.474392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:02.482497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-abd44078-0775-4d26-b193-66031693bf5f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.143430 Nov 21 17:23:02.483091 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 468/943] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:23:03.501154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:03.501693 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:03.507552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:03.508002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:03.508778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:03.509214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:03.634248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:03.642202 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-851723a4-5a43-4ce8-866b-35d42d9cf3df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144850 Nov 21 17:23:03.642794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 476/944] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:04.659246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:04.659845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:04.665639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:04.666077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:04.666864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:04.667294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:04.791763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:04.799925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9942df43-4c71-4ed7-b350-4af65389d442 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144382 Nov 21 17:23:04.800507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 469/945] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:05.817806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:05.818409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:05.824986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:05.825436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:05.826210 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:05.826663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:05.952125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:05.959667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8771f17a-dff3-40b8-a7ae-d6bd65528b60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145623 Nov 21 17:23:05.960243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 477/946] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:06.977307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:06.977924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:06.985078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:06.985522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:06.986402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:06.986751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:07.111779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:07.120012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e41431dc-969e-4567-b0aa-9330112f2aa4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.146284 Nov 21 17:23:07.120584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 470/947] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:08.137277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:08.137997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:08.144840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:08.145277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:08.146033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:08.146456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:08.267001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:08.278299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a9e74540-e2ba-4971-9031-bff54ffbf091 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144602 Nov 21 17:23:08.279517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 478/948] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:09.299737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:09.300379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:09.306139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:09.306585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:09.307375 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:09.307860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:09.429223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:09.437996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-29002285-81cb-49d8-bcb3-c3608ec17183 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142016 Nov 21 17:23:09.438566 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 471/949] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:10.457106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:10.457743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:10.463620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:10.464067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:10.464835 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:10.465265 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:10.589191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:10.603099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-279cbaf4-c33e-40b1-a0f7-25dde9c8491f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.150391 Nov 21 17:23:10.603868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 479/950] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:11.619812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:11.620423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:11.628257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:11.628838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:11.629710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:11.630139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:11.761487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:11.768975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bf55b60f-dc5c-4be3-9669-77837aa92e95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.152904 Nov 21 17:23:11.769604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 472/951] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:12.785428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:12.786129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:12.792166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:12.792715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:12.794117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:12.794551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:12.924196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:12.931760 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-306d6e06-3d05-4346-9ca3-5e7cfbb0195b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.150109 Nov 21 17:23:12.932241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 480/952] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:23:13.950304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:13.950931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:13.956924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:13.957362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:13.958106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:13.958530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:14.078567 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:14.086431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-21c59ff4-5cf7-4675-96df-8e64e996f2fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.140527 Nov 21 17:23:14.087119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 473/953] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:15.105816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:15.106516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:15.112787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:15.113237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:15.114021 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:15.114452 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:15.245162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:15.252949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-422520f1-2fe8-4b1f-ae46-6f00081e8cbd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.151436 Nov 21 17:23:15.253526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 481/954] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:16.270986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:16.271584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:16.278724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:16.279171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:16.279933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:16.280362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:16.405535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:16.412825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b34d2248-2fc8-4949-893f-88c41bbd898d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145567 Nov 21 17:23:16.413384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 474/955] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:17.430841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:17.431436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:17.437827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:17.438272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:17.439082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:17.439510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:17.561087 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:17.568571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b98f2943-4026-4458-a266-202949339c07 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141415 Nov 21 17:23:17.569141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 482/956] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:18.586221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:18.586862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:18.593345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:18.593796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:18.594562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:18.595025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:18.713042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:18.720627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-548ad1d0-51a4-4ce2-a25f-bd8622c43ceb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138013 Nov 21 17:23:18.721204 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 475/957] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:19.738970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:19.739591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:19.746706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:19.747159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:19.747946 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:19.748382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:19.875482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:19.883099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c46b00cd-9284-4df1-960b-42730e6e4f53 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.147774 Nov 21 17:23:19.883673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 483/958] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:20.900948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:20.901591 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:20.907600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:20.908040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:20.908792 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:20.909219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:21.027810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:21.035378 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-22d5a4b2-c380-4213-8414-9206ce309f5c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138061 Nov 21 17:23:21.035948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 476/959] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:22.053216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:22.053764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:22.060371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:22.060823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:22.061595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:22.062042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:22.179848 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:22.187726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3604b11c-5505-47a8-a1e0-b13dc2a10c5d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138230 Nov 21 17:23:22.188284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 484/960] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:23.205271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:23.205883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:23.211625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:23.212192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:23.212963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:23.213399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:23.345497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:23.355631 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dfaae616-a855-436d-9fbf-909ef879f162 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.153367 Nov 21 17:23:23.356363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 477/961] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:24.375171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:24.376457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:24.382861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:24.383315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:24.384155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:24.384592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:24.508598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:24.516020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-98345113-95fe-43aa-a765-b1dce08fc017 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144540 Nov 21 17:23:24.516580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 485/962] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:23:25.532772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:25.533412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:25.539331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:25.539782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:25.540540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:25.540968 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:25.662977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:25.670920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4d7e47c8-545b-4fd2-90e5-1ec78fdf8439 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141709 Nov 21 17:23:25.671484 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 478/963] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:26.688298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:26.688860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:26.694592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:26.695074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:26.695826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:26.696256 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:26.820486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:26.829935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2f2b63bd-6c63-4c65-ac8b-073c31c66fc2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145288 Nov 21 17:23:26.830511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 486/964] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:27.847026 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:27.847639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:27.853521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:27.853970 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:27.855469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:27.855793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:27.975155 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:27.983321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9e6d939-e30b-416d-a4e4-cde39c8928b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139887 Nov 21 17:23:27.983817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 479/965] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:29.000740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:29.001342 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:29.007188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:29.007632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:29.008383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:29.008811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:29.127519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:29.134695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-299cb0fd-0d63-45f6-9d6a-91bca6a2223f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137626 Nov 21 17:23:29.135261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 487/966] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:30.153572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:30.154169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:30.159975 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:30.160417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:30.161166 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:30.161588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:30.281896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:30.290663 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-517b916b-da55-4999-858c-20bb385bd000 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141465 Nov 21 17:23:30.291232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 480/967] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:31.307787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:31.308752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:31.314813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:31.315486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:31.316264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:31.316696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:31.439215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:31.446381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-58b55693-ce14-4e2b-b182-9c3d74e3c430 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142336 Nov 21 17:23:31.446976 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 488/968] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:23:32.465621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:32.466727 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:32.475606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:32.476055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:32.476835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:32.477272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:32.605959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:32.614193 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-182d3140-ecb3-42a8-a84c-30567da60b52 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.153075 Nov 21 17:23:32.614792 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 481/969] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:33.631793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:33.632386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:33.639288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:33.639724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:33.640474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:33.640896 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:33.771458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:33.771858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6080d599-1076-4d58-bd93-45d67a5bd7b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.143492 Nov 21 17:23:33.772584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 489/970] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:34.788964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:34.789599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:34.796291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:34.796735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:34.797496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:34.797925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:34.925969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:34.933786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3012f51b-0304-460b-a048-bd397d611bd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.148501 Nov 21 17:23:34.934354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 482/971] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:35.951101 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:35.951707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:35.957738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:35.958187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:35.958984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:35.959418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:36.078414 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:36.086117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2e903dfd-acea-493a-97a8-722ea9f8cd21 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139299 Nov 21 17:23:36.086709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 490/972] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:37.104359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:37.105018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:37.110892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:37.111336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:37.112103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:37.112528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:37.233023 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:37.240472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1d1c2a7e-f3e9-4f6e-917e-8d38f31f51a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.140170 Nov 21 17:23:37.241085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 483/973] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:38.259157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:38.259697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:38.266366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:38.266851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:38.267613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:38.268044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:38.387250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:38.394469 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7f61692b-9290-4d44-b7ac-2c689c0c5932 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139238 Nov 21 17:23:38.395057 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 491/974] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:39.412192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:39.412796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:39.419379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:39.419833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:39.420599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:39.421071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:39.539751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:39.547577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e67c1275-ceef-4008-b197-7ba90e3a6ce7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139073 Nov 21 17:23:39.548146 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 484/975] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:40.564686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:40.565325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:40.571134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:40.571583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:40.572349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:40.573300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:40.700906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:40.708397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5a037255-6979-46aa-8299-a537ae0cb3ee tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.147440 Nov 21 17:23:40.709007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 492/976] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:41.726236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:41.726875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:41.733621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:41.734071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:41.734930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:41.735366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:41.855013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:41.863062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bb78cd20-b80c-4a50-9925-3308275c9579 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.140504 Nov 21 17:23:41.863617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 485/977] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:42.879954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:42.880563 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:42.886314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:42.887239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:42.888005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:42.888447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:43.005915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:43.013204 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-58535a00-0f16-467c-bb17-2717890dda6e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.136875 Nov 21 17:23:43.013768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 493/978] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:44.029467 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:44.030001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:44.036071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:44.036528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:44.037294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:44.037747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:44.251996 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:44.259334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ed62ad7b-e01f-49d2-aacb-30e2ae1022be tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.233724 Nov 21 17:23:44.259904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 486/979] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:45.276492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:45.277206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:45.283572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:45.284024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:45.284787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:45.285246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:45.407216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:45.414297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ca50f75c-5ee5-417b-8dda-d4a8a06e9cd9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141612 Nov 21 17:23:45.414893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 494/980] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:46.431279 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:46.431883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:46.438015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:46.438463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:46.439271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:46.439708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:46.557171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:46.565281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3b320969-03f8-4e3b-8254-a29ba9e30d14 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137576 Nov 21 17:23:46.565850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 487/981] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:47.583637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:47.584240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:47.589959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:47.590397 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:47.591210 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:47.591638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:47.711492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:47.719003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c0d138d6-1b6a-4ad6-88cc-4b7cffcd0ed7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138937 Nov 21 17:23:47.719561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 495/982] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:48.735986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:48.736599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:48.742543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:48.743017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:48.743780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:48.744212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:48.864862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:48.872231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-44368877-5431-42ce-b7d2-54673eb3a758 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139896 Nov 21 17:23:48.872800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 488/983] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:49.890379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:49.891082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:49.896857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:49.897306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:49.898104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:49.898539 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:50.016168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:50.023326 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ef513df4-96ed-4258-96dc-8ad9af22ba1c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137318 Nov 21 17:23:50.023895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 496/984] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:51.041069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:51.041681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:51.048600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:51.049042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:51.053935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:51.053935 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:51.175262 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:51.183778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3a26cb6d-0e7e-46e0-9c30-22c068ce672c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145798 Nov 21 17:23:51.184350 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 489/985] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:52.201784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:52.202412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:52.208459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:52.208905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:52.209660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:52.210093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:52.328448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:52.336005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d4dfefab-770b-4961-a4f3-0bdbc9c44f91 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138590 Nov 21 17:23:52.336564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 497/986] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:53.353057 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:53.353699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:53.359588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:53.360038 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:53.360796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:53.361229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:53.479778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:53.487490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f7b58b0d-9637-4e01-82a8-e63e6193e1e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138138 Nov 21 17:23:53.488104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 490/987] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:54.504785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:54.505432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:54.511082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:54.511674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:54.512432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:54.512868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:54.632874 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:54.640346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-013a9b0f-b76e-4951-9355-b74c0ad75145 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139304 Nov 21 17:23:54.640906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 498/988] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:55.657704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:55.658526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:55.665705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:55.666253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:55.667073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:55.668042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:55.787662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:55.795662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-121b266b-066c-427c-a190-714762790360 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141997 Nov 21 17:23:55.796222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 491/989] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:56.812661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:56.813241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:56.819179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:56.819622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:56.820385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:56.820811 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:56.952029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:56.959423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-031c244a-1418-44a0-9f97-cb182d0d9179 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.150405 Nov 21 17:23:56.959973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 499/990] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:23:57.976775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:57.977381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:57.984274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:57.984699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:57.985470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:57.985895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:58.112261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:58.119483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c6f3171c-3dff-4d8d-92c3-3c51acd150fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.146332 Nov 21 17:23:58.120045 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 492/991] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:23:59.136886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:23:59.138122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:23:59.144001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:59.144459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:59.145227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:23:59.145659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:23:59.263003 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:23:59.270154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2899e40a-9b64-4bd5-80e0-3bef0f701217 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137169 Nov 21 17:23:59.270753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 500/992] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:23:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:00.287220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:00.287790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:00.294170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:00.294765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:00.295530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:00.295964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:00.413679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:00.421116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e0b071b1-6d94-4c00-a7e6-57fa255f0990 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137628 Nov 21 17:24:00.421676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 493/993] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:01.437777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:01.438373 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:01.444147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:01.444587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:01.445332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:01.445756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:01.568076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:01.576694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b2b91ff0-ba95-45b0-a191-443423edd0e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142614 Nov 21 17:24:01.577264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 501/994] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:02.594873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:02.595457 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:02.601355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:02.601806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:02.602557 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:02.603018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:02.721210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:02.728500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-155742e1-06cf-4d1b-babc-4d8ece2854fb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137327 Nov 21 17:24:02.729057 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 494/995] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:03.746899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:03.747517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:03.753763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:03.754012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:03.754809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:03.755243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:03.876977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:03.884227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-edc2f288-fc63-4356-a77f-4124297bf0ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141916 Nov 21 17:24:03.884785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 502/996] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:04.901014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:04.902472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:04.908275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:04.908721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:04.909486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:04.909924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:05.030173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:05.037416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3358a336-ff79-4eac-bb15-2432dfb329c3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.140068 Nov 21 17:24:05.037974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 495/997] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:06.054500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:06.055077 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:06.060911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:06.061365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:06.062155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:06.062589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:06.178669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:06.186137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c5259309-77eb-4847-abf9-b44ad1f224bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.135412 Nov 21 17:24:06.186712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 503/998] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:07.203720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:07.204579 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:07.210763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:07.211427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:07.212374 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:07.212799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:07.384263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:07.391695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-33620f99-8350-4083-854b-cd18de8acfc0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.192177 Nov 21 17:24:07.392264 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 496/999] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:08.417281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:08.417907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:08.424595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:08.424595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:08.425176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:08.425608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:08.551601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:08.558727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6a3cc895-556d-4694-8cfc-6a8415d616fd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145072 Nov 21 17:24:08.559793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 504/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:09.576942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:09.577548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:09.583647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:09.584095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:09.584861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:09.585294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:09.702142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:09.709758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4217dcf8-e8c9-4279-a1a2-306289a31e0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137283 Nov 21 17:24:09.710343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 497/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:10.727157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:10.727756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:10.733729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:10.734220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:10.735055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:10.735492 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:10.852971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:10.861037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-89435111-0b51-4b97-a2aa-69f8169cd6f4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137589 Nov 21 17:24:10.861614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 505/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:11.877652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:11.878260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:11.884165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:11.884665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:11.885376 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:11.885812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:12.004879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:12.012085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c5fb2d19-07fd-43dd-9df6-ff7a81f9db34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.138120 Nov 21 17:24:12.012655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 498/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:13.029810 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:13.030351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:13.036190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:13.036640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:13.037396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:13.037830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:13.253384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:24:13.254004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:24:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:24:13.448355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:13.456293 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-01ac257e-8a30-48bf-a0d4-f1d9f77a4f6d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.430404 Nov 21 17:24:13.456855 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 506/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:14.474079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:14.474868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:14.483254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:14.483713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:14.484500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:14.484942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:14.607389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:14.614577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0e9c44ea-6374-4154-b672-0d60a9f4ed45 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.144376 Nov 21 17:24:14.615180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 499/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:15.631752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:15.632584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:15.639049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:15.639519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:15.640309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:15.640740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:15.761342 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:15.769166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7606c9c8-97d9-4574-bf6b-b4276ec65713 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141197 Nov 21 17:24:15.769765 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 507/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:16.786526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:16.787149 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:16.792948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:16.793387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:16.794841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:16.795291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:16.921763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:16.928878 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-065883d0-76a0-4873-9fd0-16f9d78b8a23 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145993 Nov 21 17:24:16.929430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 500/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:17.945586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:17.946199 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:17.951998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:17.952443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:17.953204 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:17.953632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:18.082891 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:18.090150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-310c653b-d741-4803-a2a0-c70a4e8d2636 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.148124 Nov 21 17:24:18.091334 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 508/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:19.107674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:19.108291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:19.114136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:19.114576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:19.115493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:19.115919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:19.237236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:19.245514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-75d94714-83ff-4e41-815a-44343406e461 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141559 Nov 21 17:24:19.246017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 501/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:20.263004 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:20.263613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:20.270827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:20.271279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:20.272187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:20.272974 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:20.396564 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:20.404485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-39e5e8a1-0596-4c53-9817-bb15dce502a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.145191 Nov 21 17:24:20.405045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 509/1010] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:21.422122 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:21.422726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:21.429144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:21.429592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:21.430356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:21.430834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:21.549402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:21.556602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6c8571b0-6b92-4c1c-901f-bce6bc50f25e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139011 Nov 21 17:24:21.557159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 502/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:22.574203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:22.574828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:22.581759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:22.582197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:22.582969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:22.583392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:22.705437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:22.712669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aff87a95-5c3f-4d1e-aff0-79cc72f6c202 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142152 Nov 21 17:24:22.713232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 510/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:23.730524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:23.731735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:23.737536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:23.737977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:23.738756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:23.739181 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:23.861844 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:23.869268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8bf48d7d-a5cd-443a-ad38-49ebb1350c7f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142400 Nov 21 17:24:23.869875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 503/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:24.886856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:24.888118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:24.893991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:24.894435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:24.895213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:24.895644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:25.015219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:25.022317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f997a4d1-5e5b-4411-a02f-1b5265e1e5a1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.139125 Nov 21 17:24:25.022905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 511/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:26.039221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:26.039755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:26.046317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:26.046804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:26.047575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:26.047998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:26.168862 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:26.176679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-acc86fde-63ad-4e80-88c1-274ea735563f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141175 Nov 21 17:24:26.177230 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 504/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:27.193782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:27.194371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:27.200123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:27.200594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:27.201358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:27.201767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:27.325415 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:27.332905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e4520487-1ddb-4635-aa60-cc2e98d9cd1b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142781 Nov 21 17:24:27.333460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 512/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:28.349697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:28.350426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:28.356204 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:28.356658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:28.357909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:28.358344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:28.478392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:28.487489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0a7a3b99-2ec4-4f3f-be61-2f88d54d8b35 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.141277 Nov 21 17:24:28.488255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 505/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:29.504400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:29.505018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:29.510847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:29.511291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:29.512055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:29.512487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:29.631379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:29.638557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0c0e5989-47a1-4011-a95f-e9270fc62409 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.137721 Nov 21 17:24:29.639151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 513/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:30.656857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:30.657542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:30.663405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:30.663846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:30.664603 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:30.665027 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:30.788053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:30.795404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-900847b5-0062-4dee-9472-7e0244f368a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.142384 Nov 21 17:24:30.796012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 506/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:31.813664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:31.814272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:31.820058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:31.820506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:31.821257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:31.821715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:31.940841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:31.948176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1bc5911a-4d42-450b-81da-4058e040d1ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138691 Nov 21 17:24:31.948741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 514/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:32.965891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:32.966444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:32.973029 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:32.973477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:32.974235 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:32.974694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:33.093750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:33.100974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e24f9704-320f-4800-9adc-5e7683946a9b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139000 Nov 21 17:24:33.101539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 507/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:34.117506 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:34.118086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:34.123807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:34.124485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:34.125274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:34.125704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:34.249837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:34.258032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ef22475e-e9cb-47f6-83d8-b54f0090e367 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144091 Nov 21 17:24:34.258609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 515/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:35.275999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:35.276586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:35.283084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:35.283525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:35.284321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:35.284694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:35.406047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:35.413245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c6b3a5e4-3d49-49c1-9566-8bbf86ce5396 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140969 Nov 21 17:24:35.413811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 508/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:36.431144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:36.431775 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:36.438024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:36.438459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:36.439239 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:36.439665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:36.557739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:36.565613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b14d0740-951b-4d93-a9d6-8c819a764531 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138269 Nov 21 17:24:36.566171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 516/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:37.583561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:37.584161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:37.589956 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:37.590400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:37.591181 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:37.591611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:37.714377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:37.722283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-518bceb8-9343-4fe1-9e00-9d2656233803 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142600 Nov 21 17:24:37.722866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 509/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:24:38.739694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:38.740301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:38.746023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:38.746466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:38.747252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:38.747684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:38.869619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:38.877370 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-975900ba-e9ec-4845-ae41-74f15d876f2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141342 Nov 21 17:24:38.877930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 517/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:39.894204 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:39.894858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:39.900526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:39.900963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:39.901704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:39.902126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:40.020671 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:40.027869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9f7d997c-1c92-41a0-9756-ef6b44c4e901 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137330 Nov 21 17:24:40.028434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 510/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:41.045162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:41.045698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:41.051572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:41.052044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:41.052803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:41.053238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:41.179611 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:41.186936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e1e5fb8f-da97-4034-bab3-c3c51bf68058 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145533 Nov 21 17:24:41.188018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 518/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:42.204249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:42.204857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:42.211095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:42.211534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:42.212285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:42.212711 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:42.331692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:42.338870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6c4f0687-b7c3-4541-959e-b923564bffac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138240 Nov 21 17:24:42.339429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 511/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:43.356225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:43.356862 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:43.363232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:43.363672 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:43.364419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:43.364847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:43.484842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:43.491997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6baa6519-5d40-4fd7-a949-77c7250a9233 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139348 Nov 21 17:24:43.492573 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 519/1030] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:44.509137 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:44.509699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:44.515306 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:44.515825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:44.516570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:44.516993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:44.638348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:44.645750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9b983ec1-a875-486a-8bf7-71f393829e48 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140371 Nov 21 17:24:44.646308 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 512/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:45.270698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:24:45.271131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:24:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:24:45.662648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:45.663261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:45.669159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:45.669606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:45.670369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:45.670841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:45.792020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:45.799996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-79d6a4a4-0707-455a-b69f-86718be2270d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141051 Nov 21 17:24:45.800553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 520/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:46.817120 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:46.817712 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:46.823717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:46.826755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:46.826755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:46.826755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:46.948037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:46.956159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-60fb7e4e-d34d-4e12-8346-ada4ee74c2bb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142672 Nov 21 17:24:46.956717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 513/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:47.973793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:47.974405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:47.980323 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:47.980773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:47.981570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:47.982005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:48.106764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:48.115078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-67186f88-a2bb-4c68-b475-c6fd5f3c8499 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144896 Nov 21 17:24:48.115642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 521/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:49.131957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:49.132565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:49.138443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:49.138929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:49.139682 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:49.140115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:49.259288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:49.267656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ee482ce2-40b8-49b1-8b42-c1f9ab0f2da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139283 Nov 21 17:24:49.268228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 514/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:50.285203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:50.285798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:50.291569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:50.292015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:50.292768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:50.293322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:50.411787 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:50.419093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2bfbadf8-d437-47b5-b799-9e0bc8603fb8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138095 Nov 21 17:24:50.419661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 522/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:51.435309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:51.435959 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:51.441645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:51.442089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:51.442869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:51.443297 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:51.564936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:51.572180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e13ed95b-d712-4136-9ec4-cd63cbbc4db5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140602 Nov 21 17:24:51.572736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 515/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:52.589643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:52.590226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:52.596098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:52.596542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:52.597300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:52.597754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:52.726055 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:52.733379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f554bf7b-798e-4f60-be79-7994e3a248b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.147460 Nov 21 17:24:52.733942 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 523/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:53.750839 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:53.751625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:53.757285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:53.757729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:53.758495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:53.758958 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:53.877837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:53.885031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-285f561c-7cb0-48f8-a57d-a2c25119aadd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138028 Nov 21 17:24:53.885595 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 516/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:54.902062 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:54.902694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:54.908460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:54.908911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:54.909670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:54.910103 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:55.033448 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:55.040695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ebc91915-73f8-46a2-8a29-1d9529bbf949 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142329 Nov 21 17:24:55.041257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 524/1040] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:56.058499 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:56.059077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:56.065424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:56.065874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:56.066644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:56.067097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:56.186920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:56.194982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2e686eeb-26ee-4b23-a69e-f14e7c9c718e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140202 Nov 21 17:24:56.195558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 517/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:57.212508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:57.213095 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:57.218962 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:57.220000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:57.220945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:57.221380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:57.343820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:57.351680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-91d7e4f1-d5f0-4fbf-a1a7-7abc6105c35a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142837 Nov 21 17:24:57.352242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 525/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:58.367823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:58.368428 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:58.374141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:58.374582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:58.375351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:58.375952 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:58.501286 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:58.509384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-495a5245-d3de-417c-a334-9eec50e64676 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144862 Nov 21 17:24:58.509812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 518/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:58 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:24:59.526481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:24:59.527144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:24:59.533694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:59.534175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:59.534956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:24:59.535391 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:24:59.653384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:24:59.660589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6291a721-554b-4685-af37-6ca009895aa1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137770 Nov 21 17:24:59.661148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 526/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:24:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:00.677356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:00.677957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:00.683787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:00.684275 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:00.685036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:00.685504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:00.806801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:00.814483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0edbee09-b466-4b75-84e5-a8e5c876c42c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141350 Nov 21 17:25:00.815368 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 519/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:01.832702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:01.833308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:01.839224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:01.839676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:01.840442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:01.840871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:01.963073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:01.971384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b24f314e-2111-479e-9473-bce0e9f0da0f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142652 Nov 21 17:25:01.971945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 527/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:02.986950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:25:02.990132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:02.990755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:02.996529 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:02.996980 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:02.997730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:02.998161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:03.059520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:25:03.060125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:25:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:25:03.121775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:03.129159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b54c29f9-2b45-4a03-9f96-7658df9f40a4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144250 Nov 21 17:25:03.129746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 520/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:04.146631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:04.147286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:04.153105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:04.153554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:04.154311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:04.154771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:04.279375 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:04.286728 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6a9a9546-bf84-4ffc-877e-7be0cfe07bc6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143726 Nov 21 17:25:04.287441 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 528/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:05.304114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:05.304811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:05.322329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:05.322809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:05.323572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:05.324003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:05.332770 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41614. Nov 21 17:25:05.453460 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:05.461514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a4c437fe-4e80-4c39-8a79-5daa15d5ef81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.161054 Nov 21 17:25:05.462082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 521/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:06.476826 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:25:06.480092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:06.480733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:06.487470 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:06.487954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:06.488755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:06.489192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:06.607467 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:06.615418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e961ae67-62a3-4763-9b37-4908d40efdc1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139931 Nov 21 17:25:06.615975 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 529/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:07.632319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:07.632840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:07.638607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:07.639096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:07.639857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:07.640294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:07.760764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:07.768250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e9246cba-7c4e-4b7e-9418-9b2b6139db60 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139623 Nov 21 17:25:07.768807 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:08.785601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:08.786197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:08.806987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:08.807431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:08.808191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:08.808612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:08.815488 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 41642. Nov 21 17:25:08.934304 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:08.942392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f0509cc3-e825-497f-b533-b617cd2bcf7e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.160990 Nov 21 17:25:08.942978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 530/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:09.960125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:09.960677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:09.966351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:09.966832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:09.967577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:09.968001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:10.088501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:10.095666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bace25a0-e875-4afe-8250-595211dc76e8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139506 Nov 21 17:25:10.096219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 523/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:11.113061 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:11.113652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:11.119446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:11.119886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:11.120632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:11.121056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:11.239679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:11.246786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-972b57d1-25f8-4fdc-83ef-9c0de5509426 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138328 Nov 21 17:25:11.247339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 531/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:12.264278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:12.264888 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:12.270725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:12.271203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:12.271965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:12.272397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:12.395326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:12.402742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a1c11e88-0542-4b3a-b97d-10977cf794eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142212 Nov 21 17:25:12.403305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:13.420176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:13.420888 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:13.426917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:13.427365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:13.428129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:13.428561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:13.612979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:13.620272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2b9f8249-4ecb-4099-a69e-cb1be20f00ab tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.203689 Nov 21 17:25:13.620830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 532/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:14.637367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:14.638006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:14.644004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:14.644442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:14.645204 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:14.645638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:14.774648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:14.782112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-30e83b9f-3c54-45a5-82b8-acfdfcbf4911 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.148420 Nov 21 17:25:14.783308 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 525/1057] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:15.759669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:15.760167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:15.765925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:15.766379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:15.767711 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:15.768236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:15.800121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:15.800733 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:15.806503 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:15.807000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:15.807799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:15.808317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:15.862093 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lazy-loading 'services' on Instance uuid d04b8ac9-3c74-4720-9ee3-03113212ad92 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:25:15.928679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-13fe63af-dd15-4019-9392-6354033c32c5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92/os-volume_attachments/14347942-f2ef-4720-85fa-00c5f2437784" status: 202 len: 0 microversion: 2.1 time: 0.172422 Nov 21 17:25:15.932217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 533/1058] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:25:15 2021] DELETE /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92/os-volume_attachments/14347942-f2ef-4720-85fa-00c5f2437784 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:25:15.954201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:15.963366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-da168603-f310-479d-9d59-82f0d3d4b65a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.167152 Nov 21 17:25:15.964223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 526/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:25:16.981930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:16.982650 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:16.989401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:16.989851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:16.990609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:16.991120 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:17.114932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:17.122113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2fc0e186-1fab-420c-89ee-0ddef692cb8c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144240 Nov 21 17:25:17.122681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 534/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:18.139031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:18.139640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:18.145919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:18.146644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:18.147414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:18.147849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:18.269685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:18.276818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1a19727b-d139-487f-a931-5e09f705e47a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141444 Nov 21 17:25:18.277373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 527/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:19.293928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:19.294458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:19.300643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:19.301088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:19.301854 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:19.302289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:19.420776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:19.428206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fa515c83-02b9-4bce-9154-e9ef78f61956 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137952 Nov 21 17:25:19.428767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 535/1062] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:20.445120 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:20.445724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:20.451785 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:20.452234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:20.453002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:20.453441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:20.574178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:20.582266 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e3451d15-624e-4623-bbf1-5f699831e9e0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140788 Nov 21 17:25:20.582856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 528/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:21.599333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:21.599920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:21.605671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:21.606121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:21.606914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:21.607347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:21.728349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:21.736161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ac52e9d3-7511-462d-ba2e-e8d13c903e42 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140538 Nov 21 17:25:21.737025 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 536/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:22.753796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:22.754431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:22.760508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:22.760965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:22.761788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:22.762225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:22.882472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:22.890102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8067b537-0ce3-4c0d-a23d-1c6dd52984f1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140223 Nov 21 17:25:22.890692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 529/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:23.908240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:23.908827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:23.914562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:23.915030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:23.915778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:23.916207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:24.033833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:24.041045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9b48830b-5e13-4e1e-9468-adb9a82162e7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.136959 Nov 21 17:25:24.041605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 537/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:25.058263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:25.058851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:25.065470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:25.065924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:25.066720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:25.067158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:25.186722 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:25.194028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ffa84d6-4d89-4895-bf3c-34a407dc7113 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139495 Nov 21 17:25:25.194593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 530/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:26.211468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:26.212073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:26.218073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:26.218525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:26.219323 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:26.219760 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:26.341698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:26.349398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-58b33e51-49a1-453e-bccb-c6aa31d6d622 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141698 Nov 21 17:25:26.349965 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 538/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:27.366517 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:27.367191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:27.373311 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:27.373789 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:27.374547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:27.375010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:27.498014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:27.505973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7bd9b646-5396-473f-b33c-51173086eb51 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143111 Nov 21 17:25:27.506535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 531/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:28.523593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:28.524197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:28.529883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:28.530324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:28.531099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:28.531521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:28.653216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:28.661318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-edd851bc-0f10-41a8-84d3-92802d5eff6f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141227 Nov 21 17:25:28.670597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 539/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:29.678632 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:29.679247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:29.685074 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:29.685511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:29.686260 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:29.686714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:29.806301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:29.814477 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cb3ed815-0e72-4db0-a9b8-4d1b99c988ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139633 Nov 21 17:25:29.815469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 532/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:30.834096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:30.836039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:30.841884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:30.842332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:30.843124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:30.843553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:30.968138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:30.976260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-739be4ab-584a-4dd7-a871-7d533bf2cadb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.147795 Nov 21 17:25:30.976889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 540/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:31.993843 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:31.994442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:32.000199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:32.000641 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:32.001384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:32.001812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:32.123900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:32.131969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8abbb28a-9def-49d2-88ff-4401ec61248a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141714 Nov 21 17:25:32.132540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 533/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:33.149790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:33.150340 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:33.156165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.156614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.157377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.157849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.276616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:33.283834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-30d2614b-a7ac-43de-b97a-84021c6b497a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137916 Nov 21 17:25:33.284950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 541/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:33.707265 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:33.707774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:33.713593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.714072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.714887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.715324 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.742234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:25:33.813333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ec5e42df-f050-4bed-906d-17695cabaa1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 204 len: 0 microversion: 2.20 time: 0.109679 Nov 21 17:25:33.813913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 534/1075] 10.222.0.52 () {60 vars in 1279 bytes} [Sun Nov 21 17:25:33 2021] DELETE /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 17:25:33.822516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:33.823156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:33.828908 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.829356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.830108 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:33.830534 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:33.954141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:33.963950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:33.965451 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:33.966676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ad927d76-efc0-4cd4-8637-5575ad4d1d93 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1723 microversion: 2.20 time: 0.147837 Nov 21 17:25:33.967256 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 542/1076] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:25:33 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:25:34.301638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:34.302339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:34.308139 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:34.308588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:34.309355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:34.309791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:34.458754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:34.466103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9ee81b27-98e5-45cc-b424-7dac412a0ef8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.168647 Nov 21 17:25:34.466689 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 535/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:34.985430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:34.986175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:34.993044 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:34.993575 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:34.994267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:34.995538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:35.094978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:35.103322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:35.104945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '157b3c042cc5472480ed78415048c756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea840f1e2fe94ebdadee6455cf668d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:35.106173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-59d497f0-8647-4173-87b0-b2be0546dad1 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 200 len: 1655 microversion: 2.20 time: 0.124802 Nov 21 17:25:35.106847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 543/1078] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:25:34 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 21 17:25:35.352670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-ee10a761-ed40-43c0-9c9f-74cbe17e71de req-079c4d97-5f7c-45ee-bf7c-e95d8c9efaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1cec94-c4f2-4f9e-8490-35c03810625f", "name": "network-vif-deleted", "tag": "5bc4eaf6-2fdf-4242-aaf4-c743af87c815"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:25:35.354221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:25:35.354221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:25:35.361290 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-ee10a761-ed40-43c0-9c9f-74cbe17e71de req-079c4d97-5f7c-45ee-bf7c-e95d8c9efaee service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:35.361565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-ee10a761-ed40-43c0-9c9f-74cbe17e71de req-079c4d97-5f7c-45ee-bf7c-e95d8c9efaee service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:35.376917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-ee10a761-ed40-43c0-9c9f-74cbe17e71de req-079c4d97-5f7c-45ee-bf7c-e95d8c9efaee service nova] Creating event network-vif-deleted:5bc4eaf6-2fdf-4242-aaf4-c743af87c815 for instance ce1cec94-c4f2-4f9e-8490-35c03810625f on hv-cinder-81869 Nov 21 17:25:35.381973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-ee10a761-ed40-43c0-9c9f-74cbe17e71de req-079c4d97-5f7c-45ee-bf7c-e95d8c9efaee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091162 Nov 21 17:25:35.385824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 536/1079] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:25:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:25:35.483979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:35.484798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:35.491930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:35.492526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:35.493580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:35.494298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:35.636917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:35.647502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c9586fb7-55e5-402a-8bab-e283d6f22178 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.167030 Nov 21 17:25:35.648340 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 544/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:36.125784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:36.126475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:36.133806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:36.134300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:36.135107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:36.135546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:36.149104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. Nov 21 17:25:36.149707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:25:36.150552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0316d4ee-1335-47c3-9ba1-67b80c4cdc87 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 404 len: 111 microversion: 2.20 time: 0.028951 Nov 21 17:25:36.151145 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 537/1081] 10.222.0.52 () {60 vars in 1276 bytes} [Sun Nov 21 17:25:36 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 21 17:25:36.159450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e7329268-fe8f-4dde-84fd-d11c1af42eae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '.version_select at 0x7f1fbd8068b0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:36.182349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e7329268-fe8f-4dde-84fd-d11c1af42eae tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-423750793" status: 204 len: 0 microversion: 2.20 time: 0.026574 Nov 21 17:25:36.182964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 545/1082] 10.222.0.52 () {60 vars in 1258 bytes} [Sun Nov 21 17:25:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-423750793 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 21 17:25:36.665382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:36.665993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:36.671758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:36.672195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:36.672949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:36.673377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:36.867904 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:36.875017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9618e13b-2e6f-4ada-ae56-e1f344ae3d22 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.213355 Nov 21 17:25:36.875584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 538/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:37.892128 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:37.892741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:37.898863 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:37.899313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:37.900636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:37.901061 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:38.026998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:38.034277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d8c4afa6-5015-48e8-9980-b22918b9e92b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145830 Nov 21 17:25:38.035723 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 546/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:39.051574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:39.052185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:39.058031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:39.058475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:39.059277 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:39.059716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:39.179945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:39.187242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-53faf37b-39dd-4fbb-a9c9-e2abe42c6a9f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139345 Nov 21 17:25:39.187802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 539/1085] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:40.204773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:40.205365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:40.211498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:40.211935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:40.212677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:40.213100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:40.331743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:40.339180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8a373106-66a3-46e1-a98d-7b117c31a8d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138155 Nov 21 17:25:40.339733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 547/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:41.355406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:41.356088 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:41.361774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:41.362176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:41.363480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:41.364097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:41.483500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:41.491964 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cb396dda-0908-477f-bdbd-61b683cb23df tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140196 Nov 21 17:25:41.492532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 540/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:42.509525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:42.510298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:42.516682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:42.517130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:42.517891 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:42.518327 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:42.637470 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:42.645155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-082d5f9b-0fcf-4022-8c71-21dfba5c0da3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139291 Nov 21 17:25:42.645722 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 548/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:43.661923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:43.662552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:43.668438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:43.668931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:43.669634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:43.670060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:43.789489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:43.796673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7debc6b8-c645-4788-b1de-aae521256b65 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139029 Nov 21 17:25:43.797229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 541/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:44.813957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:44.814481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:44.820943 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:44.821390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:44.822150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:44.822582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:44.944804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:44.951993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-16c58368-e580-4f47-9dfa-cece97937cd0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141761 Nov 21 17:25:44.952549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 549/1090] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:45.969560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:45.970189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:45.976256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:45.976709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:45.977466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:45.977902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:46.095997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:46.103885 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9688b139-54a6-4ebd-9b8d-ca1d27b82ac4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137971 Nov 21 17:25:46.104543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 542/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:47.120932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:47.121523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:47.127401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:47.127878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:47.128951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:47.129390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:47.246991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:47.254763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-4616aea0-d3c9-4446-a37e-1d18d7ecf6cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137478 Nov 21 17:25:47.255336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 550/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:48.271733 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:48.272325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:48.278102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:48.278539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:48.279316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:48.279745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:48.400327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:48.407542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a6668fe0-d66b-41c6-9d53-894bfd009512 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139654 Nov 21 17:25:48.408112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 543/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:49.425751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:49.426373 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:49.432192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:49.432633 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:49.433388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:49.433815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:49.554161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:49.561437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2a2cffb3-9784-4db3-bee2-dee843bbf12f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139900 Nov 21 17:25:49.561930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 551/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:50.579658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:50.580250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:50.587151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:50.587609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:50.588386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:50.588825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:50.710383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:50.717702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a6ea1bd7-176c-4335-ab35-c5769f4c9749 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142136 Nov 21 17:25:50.718270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 544/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:51.735243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:51.735851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:51.742222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:51.742728 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:51.743494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:51.743960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:51.866073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:51.873402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ceab479d-4f51-4c55-b668-13765c774fcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141773 Nov 21 17:25:51.873969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 552/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:52.890987 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:52.891597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:52.898320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:52.898808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:52.899788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:52.900582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:53.021653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:53.028989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-28e10a44-db52-4af2-adfd-3ec1cdf11be5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141648 Nov 21 17:25:53.029592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 545/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:54.045051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:54.045761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:54.051757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:54.052148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:54.052917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:54.053352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:54.171242 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:54.178466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-75b67d8a-b8d9-4d8a-b608-16fb0d56f359 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137138 Nov 21 17:25:54.179064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 553/1098] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:55.195431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:55.196070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:55.201893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:55.202342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:55.203135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:55.203570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:55.330236 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:55.337693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-51d0573e-4072-4dda-a06e-3d21ac04926e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145990 Nov 21 17:25:55.338246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 546/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:56.354853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:56.355458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:56.361288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:56.361732 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:56.363116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:56.363610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:56.483300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:56.492174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-251fbe5f-daa2-4de4-bce0-ba59c5f38154 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140904 Nov 21 17:25:56.492743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 554/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:57.164265 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:25:57.164515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:25:57.256766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:25:57.257327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:25:57.509961 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:57.510530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:57.516362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:57.516813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:57.517575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:57.518014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:57.637502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:57.645486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8b26b9af-5db3-40dc-a82c-5c4e7e5cfc95 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139303 Nov 21 17:25:57.646107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 547/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:58.662717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:58.663324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:58.669134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:58.669585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:58.670345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:58.670806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:58.794227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:58.802046 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-672c8de7-e7fe-4a10-ad8d-dd996204d7ba tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143158 Nov 21 17:25:58.802590 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 555/1102] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:58 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:25:59.820354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:25:59.820867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:25:59.826960 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:59.827406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:59.828177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:25:59.828603 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:25:59.946691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:25:59.953801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-42927615-c8ad-4167-8f0a-b1646b22ebc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138452 Nov 21 17:25:59.954349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 548/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:25:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:00.970860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:00.971390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:00.978255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:00.978731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:00.979491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:00.980872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:01.102243 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:01.109608 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5301a063-787e-48b3-ae88-c3f9b3007f6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142493 Nov 21 17:26:01.110365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 556/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:02.127936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:02.128864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:02.134364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:02.134841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:02.135586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:02.136018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:02.260749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:02.268293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9b4de1b9-5800-4a1b-8ec1-edf1edbe10cb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144064 Nov 21 17:26:02.268852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 549/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:03.285698 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:03.286369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:03.292209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:03.292659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:03.293420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:03.293851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:03.418409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:03.425634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c5cadc0c-665d-4a05-a595-6ad3d8bc7441 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143710 Nov 21 17:26:03.426260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 557/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:04.442547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:04.443167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:04.448924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:04.449363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:04.450110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:04.450535 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:04.570609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:04.577806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a35a64ed-5dcf-47d2-9139-478fe877a804 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138868 Nov 21 17:26:04.578365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 550/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:05.595179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:05.595782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:05.602070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:05.602541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:05.603325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:05.603749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:05.729266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:05.736884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-41e0815a-5a53-423b-9665-49764f9a4055 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145174 Nov 21 17:26:05.737281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 558/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:06.753452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:06.754158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:06.760555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:06.760993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:06.761769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:06.762195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:06.882253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:06.889875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-50085cf5-1e5a-4c00-9166-664ab643b097 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140142 Nov 21 17:26:06.890435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 551/1109] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:07.906919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:07.907526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:07.913690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:07.914141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:07.914929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:07.915367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:08.033638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:08.040831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2bf47611-99ee-4a33-8aaf-4486a9544aac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137546 Nov 21 17:26:08.041390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 559/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:09.057344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:09.057895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:09.063653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:09.064095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:09.064847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:09.065274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:09.184974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:09.192708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a115d2ad-9e7c-4cd4-9d6a-393c0c4faba1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139040 Nov 21 17:26:09.193271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 552/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:10.210105 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:10.210681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:10.216556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:10.217009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:10.217763 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:10.218196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:10.337596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:10.345070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-38e8910b-184b-4ca3-9978-dd04ebd47f0c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139004 Nov 21 17:26:10.345624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 560/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:11.362916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:11.364079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:11.369884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:11.370332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:11.371185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:11.371620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:11.489060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:11.496676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0143519e-dd71-40f1-be2d-78c5b859d9b4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137436 Nov 21 17:26:11.497247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 553/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:12.514398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:12.515028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:12.521402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:12.521846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:12.522593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:12.523049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:12.645753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:12.652798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-22cbe642-a148-45bb-a35c-dc4cc0d6bd34 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142025 Nov 21 17:26:12.653353 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 561/1114] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:13.670328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:13.671011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:13.676906 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:13.677359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:13.678118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:13.678556 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:13.797196 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:13.804609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3d75b53d-ca31-4aec-abbe-059f8fbb56f9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137931 Nov 21 17:26:13.805169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 554/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:14.821945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:14.822566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:14.829142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:14.829709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:14.830720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:14.831340 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:14.954058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:14.962592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-46b6dae9-def5-4254-858f-73d4c75fa93c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144318 Nov 21 17:26:14.963193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 562/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:15.979501 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:15.980127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:15.985863 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:15.986355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:15.987081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:15.987507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:16.110070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:16.118170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-71fad276-f4d3-41f2-a9c9-f0707d8faf2b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142253 Nov 21 17:26:16.118763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 555/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:17.135689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:17.136284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:17.142019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:17.142456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:17.143237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:17.143660 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:17.260529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:17.267666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1de48ad0-af61-4145-8baf-5572a41d9ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.135663 Nov 21 17:26:17.268223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 563/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:18.284812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:18.285938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:18.291725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:18.292164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:18.292908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:18.293331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:18.413936 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:18.421145 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f33a2340-3dae-47b7-9dc7-e456254da9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140051 Nov 21 17:26:18.421699 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 556/1119] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:19.439295 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:19.439986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:19.446801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:19.447257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:19.448020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:19.448458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:19.568687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:19.575845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e4c84b98-2c25-45dd-ac37-2f599422f486 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140465 Nov 21 17:26:19.576403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 564/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:20.592382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:20.592982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:20.598853 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:20.599293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:20.600043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:20.600466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:20.722084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:20.729809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-acc4df5f-f899-40fa-aa65-696bccf32ab0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141079 Nov 21 17:26:20.730372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 557/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:21.746950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:21.747558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:21.753526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:21.753988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:21.755073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:21.755513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:21.873734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:21.880967 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f0ed1018-11ea-41f4-be26-c0ea66f69fb7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137663 Nov 21 17:26:21.881531 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 565/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:22.898018 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:22.898647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:22.904523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:22.904973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:22.905732 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:22.906175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:23.268132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:23.276530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-57f69b2e-31f7-436d-89f0-00bece325571 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.382339 Nov 21 17:26:23.277083 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 558/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:24.293731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:24.294335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:24.300079 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:24.300529 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:24.301978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:24.302537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:24.419132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:24.427688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ce6da085-2e0d-4f11-90ef-ceb89d95fcbc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137528 Nov 21 17:26:24.428253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 566/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:25.445557 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:25.446175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:25.451988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:25.452436 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:25.453199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:25.453634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:25.574067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:25.581479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-df577b65-ff7b-42dc-ba54-707c2a107279 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140378 Nov 21 17:26:25.582042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 559/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:26.600516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:26.601065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:26.606953 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:26.607402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:26.608154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:26.608582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:26.729610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:26.736893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-529f3bb9-050d-4c10-b65f-eabe5ebbb108 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140322 Nov 21 17:26:26.737455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 567/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:27.753642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:27.754242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:27.760370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:27.760819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:27.761617 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:27.762049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:27.880363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:27.887744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d15c2ec7-77ab-4c65-8729-5558309fd935 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137673 Nov 21 17:26:27.888313 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 560/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:28.905548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:28.906152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:28.912513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:28.912960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:28.913726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:28.914156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:29.032388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:29.040570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c5d779a0-6928-4080-bd19-dffe6c5f0e18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138601 Nov 21 17:26:29.041137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 568/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:30.057211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:30.057808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:30.063629 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:30.064071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:30.064816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:30.065244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:30.186142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:30.193542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cbe4b9e3-8e99-4260-b2ce-07640b03a701 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139960 Nov 21 17:26:30.194117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 561/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:31.210895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:31.211491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:31.217299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:31.217736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:31.218476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:31.218954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:31.338786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:31.345964 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0d2b8ac2-0fd6-442a-9def-5a1481fc919c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139076 Nov 21 17:26:31.346517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 569/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:32.363831 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:32.364407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:32.370806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:32.371249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:32.372000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:32.372426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:32.496210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:32.503645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f8ed5f7e-3ad5-4df2-a650-7baab2c27432 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143525 Nov 21 17:26:32.504214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 562/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:33.520659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:33.521809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:33.527624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:33.528059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:33.528808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:33.529232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:33.650680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:33.657785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e2a5ed22-553b-48e6-af2d-8b96483c355a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140817 Nov 21 17:26:33.658333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 570/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:34.675099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:34.675683 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:34.681911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:34.682364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:34.683159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:34.683590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:34.803200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:34.810415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0a651a43-ea69-4ec1-9ff7-e8af151fb5c1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139014 Nov 21 17:26:34.811005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 563/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:35.831674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:35.835586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:35.841352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:35.841809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:35.843062 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:35.843380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:35.965225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:35.972406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3aac52e3-3901-46f5-a323-b7fd5a008e81 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.147408 Nov 21 17:26:35.972960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 571/1134] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:36.989741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:36.990415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:36.996172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:36.996623 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:36.997381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:36.997815 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:37.121944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:37.129463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c90d44df-3c32-4521-b2f3-649406fdd4d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143566 Nov 21 17:26:37.130034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 564/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:38.147992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:38.148671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:38.154301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:38.154774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:38.155516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:38.155934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:38.273554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:38.280699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-68d46152-696c-48a9-9d29-9ff387932054 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137019 Nov 21 17:26:38.281251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 572/1136] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:39.298001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:39.298563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:39.305151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:39.305594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:39.306345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:39.306836 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:39.428748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:39.436402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-92fd0858-6af7-4af3-b672-21ec76cea8c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142156 Nov 21 17:26:39.436962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 565/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:40.453664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:40.454267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:40.460588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:40.461034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:40.461786 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:40.462217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:40.586012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:40.593230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-27fc2812-819f-4635-acf4-0ea7e8a86940 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143394 Nov 21 17:26:40.593790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 573/1138] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:41.609548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:41.610161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:41.615927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:41.616376 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:41.617141 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:41.617575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:41.737854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:41.745788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1239057f-f3c5-41d5-af42-536bd4b4bf8f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139884 Nov 21 17:26:41.746359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 566/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:42.762220 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:42.762857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:42.768726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:42.769164 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:42.769907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:42.770332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:42.888344 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:42.895511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2d63ad3e-9fc4-4bb7-bffd-9da9db74bbcf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.136927 Nov 21 17:26:42.896294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 574/1140] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:43.912361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:43.912944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:43.918712 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:43.919158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:43.919924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:43.920351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:44.041635 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:44.049002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-35d4cec6-688b-4f26-ace3-d04b3ea8270a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140234 Nov 21 17:26:44.049572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 567/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:45.066699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:45.067240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:45.073178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:45.073621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:45.074372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:45.074841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:45.193512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:45.201432 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3363ed89-b14e-4e2d-b47c-76c381a00ded tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138554 Nov 21 17:26:45.201985 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 575/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:46.219525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:46.220355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:46.226700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:46.227162 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:46.227925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:46.228356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:46.358838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:46.361429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c74a6215-1083-4e16-b017-72af7e727c7b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145681 Nov 21 17:26:46.362195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 568/1143] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:47.379214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:47.379822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:47.386459 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:47.387048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:47.387853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:47.388287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:47.515918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:47.523804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-53e8d299-b5bd-42c6-95d1-cc0207d989d2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.148495 Nov 21 17:26:47.524358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 576/1144] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:48.540582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:48.541187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:48.546974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:48.547420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:48.548187 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:48.548620 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:48.668930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:48.676171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fe468331-3608-40fc-8d1d-21ffd1c0287a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139276 Nov 21 17:26:48.676731 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 569/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:49.694832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:49.695472 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:49.701439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:49.701878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:49.702639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:49.703083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:49.822571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:49.829830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b3b9c864-a7fd-42ec-9a5e-815657258a9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139168 Nov 21 17:26:49.830389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 577/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:50.847828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:50.848438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:50.854939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:50.855399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:50.856161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:50.856606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:50.980010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:50.987321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2a9b18b1-fd3d-4cfe-8033-fdda16102d75 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143292 Nov 21 17:26:50.987884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 570/1147] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:52.004310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:52.004906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:52.010713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:52.011151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:52.011895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:52.012319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:52.132635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:52.140157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7487ac2a-aea3-46eb-89f2-8b9701f405b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139488 Nov 21 17:26:52.140716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 578/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:53.157845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:53.158471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:53.164410 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:53.164885 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:53.165615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:53.166049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:53.288015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:53.301163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-435f68c6-2566-4a9c-b6b5-b0968ce5821f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.146976 Nov 21 17:26:53.301780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 571/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:54.318578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:54.319840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:54.325554 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:54.326002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:54.326801 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:54.327255 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:54.450460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:54.457630 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e5c98956-2b59-4a94-a0a9-e2280b4a2487 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142656 Nov 21 17:26:54.458191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 579/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:55.475164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:55.475920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:55.481508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:55.481947 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:55.482719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:55.483150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:55.604726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:55.612011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ea17b9cf-46bb-40f2-9941-33771ad6f39e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140447 Nov 21 17:26:55.612565 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 572/1151] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:56.629169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:56.629764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:56.636274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:56.636716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:56.637473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:56.637906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:56.755482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:56.763794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a9b434d5-46bb-4a8e-b85b-be561afa63db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138263 Nov 21 17:26:56.764357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 580/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:26:57.781246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:57.781850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:57.788553 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:57.789017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:57.789784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:57.790222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:57.914291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:57.922041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-21f7f664-91ce-4e40-94d8-8d155bd14e3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144430 Nov 21 17:26:57.927125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 573/1153] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:26:58.938002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:26:58.938609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:26:58.944893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:58.945519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:58.946168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:26:58.946603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:26:59.071203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:26:59.078482 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f0edc223-d510-43e8-9eb1-655129ddfdfc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144087 Nov 21 17:26:59.079078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 581/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:26:58 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:00.095912 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:00.096518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:00.103687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:00.104138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:00.104896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:00.105382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:00.224574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:00.232288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7ccb1cf4-4072-48c2-9f34-760cc8908187 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140032 Nov 21 17:27:00.232852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 574/1155] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:01.249869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:01.250463 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:01.256261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:01.257209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:01.257954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:01.258376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:01.379513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:01.387479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-75d1d994-9b4d-42ac-bb18-6aab52d69769 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141242 Nov 21 17:27:01.388039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 582/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:02.404686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:02.405252 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:02.410970 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:02.411450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:02.412209 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:02.412645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:02.532270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:02.540525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6b6c4f70-364a-423d-be41-c554c4017ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139342 Nov 21 17:27:02.541441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 575/1157] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:03.557932 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:03.558486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:03.564770 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:03.565222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:03.565986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:03.566418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:03.685904 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:03.693073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-505ef29a-443d-4367-90e8-882fb36ae751 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139601 Nov 21 17:27:03.693637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 583/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:04.711915 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:04.712528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:04.718353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:04.718843 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:04.719614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:04.720051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:04.843127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:04.850433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-905d774d-5371-4a18-b935-55f1aa211f9c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143226 Nov 21 17:27:04.851046 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 576/1159] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:05.290953 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:05.291510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:05.297233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.297683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:05.298446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.298909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:05.324795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:27:05.397458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-805fce01-f4e5-4c11-865e-aea0666eb478 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 204 len: 0 microversion: 2.1 time: 0.109774 Nov 21 17:27:05.398135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 584/1160] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:27:05 2021] DELETE /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:27:05.406493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:05.407154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:05.412978 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.413491 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:05.414259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.414725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:05.535607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:05.543288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-49b74eff-877b-4b3a-8636-06a91c7b86be tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1672 microversion: 2.1 time: 0.140948 Nov 21 17:27:05.543874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 577/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:05 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1672 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:05.867417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:05.868120 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:05.874069 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.874516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:05.875322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:05.875754 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:06.063150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:06.070520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-30288dd1-f770-4eed-baad-7172ebd748b8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.207104 Nov 21 17:27:06.071123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 585/1162] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:06.561697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:06.562451 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:06.569439 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:06.569889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:06.570687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:06.571127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:06.636855 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f39e65554e2450f87950fe8645d7fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ca60f20da438e91d85bcb43057906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:06.644116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-342d8fb4-2366-4bde-9225-9f914f631025 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 200 len: 1604 microversion: 2.1 time: 0.086048 Nov 21 17:27:06.644694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 578/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:06 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 1604 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:06.801428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-08267ecf-a500-4132-bd8a-a62f257a0656 req-b27bb502-ed57-4a08-84ad-143ed2f1022b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02bcb091-a1a4-40bc-b707-333917982e30", "name": "network-vif-deleted", "tag": "2e3d300c-ffeb-467e-a720-8b0afd9b280f"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:27:06.803246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:27:06.803246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:27:06.811194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-08267ecf-a500-4132-bd8a-a62f257a0656 req-b27bb502-ed57-4a08-84ad-143ed2f1022b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:06.811642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-08267ecf-a500-4132-bd8a-a62f257a0656 req-b27bb502-ed57-4a08-84ad-143ed2f1022b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:06.828483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-08267ecf-a500-4132-bd8a-a62f257a0656 req-b27bb502-ed57-4a08-84ad-143ed2f1022b service nova] Creating event network-vif-deleted:2e3d300c-ffeb-467e-a720-8b0afd9b280f for instance 02bcb091-a1a4-40bc-b707-333917982e30 on hv-cinder-81869 Nov 21 17:27:06.833732 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-08267ecf-a500-4132-bd8a-a62f257a0656 req-b27bb502-ed57-4a08-84ad-143ed2f1022b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Nov 21 17:27:06.834555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 586/1164] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:27:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:27:07.089036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:07.089644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:07.095300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:07.095751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:07.096511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:07.096943 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:07.221983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:07.230034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e0d2e66b-aff7-4677-a1a2-53ec9f3d379a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144717 Nov 21 17:27:07.230647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 579/1165] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:07.661719 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:07.662420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:07.669308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:07.669756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:07.670549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:07.671009 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:07.684490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. Nov 21 17:27:07.685081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:27:07.685902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8de175d8-f47e-4ff7-aab7-6c13d89648d6 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 404 len: 111 microversion: 2.1 time: 0.028265 Nov 21 17:27:07.686433 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 587/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:07 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:27:07.694655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f8f0f3aa-d39e-44d1-9ceb-87ea7370f3fe tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '.version_select at 0x7f1fbd7ba4c0>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:07.717838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f8f0f3aa-d39e-44d1-9ceb-87ea7370f3fe tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115736544" status: 202 len: 0 microversion: 2.1 time: 0.026720 Nov 21 17:27:07.718418 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 580/1167] 10.222.0.52 () {58 vars in 1220 bytes} [Sun Nov 21 17:27:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115736544 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:27:08.247896 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:08.248655 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:08.254388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:08.254882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:08.255661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:08.256431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:08.389059 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:08.396856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-432c0def-c501-4893-81cb-8ef9247a6db1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.153437 Nov 21 17:27:08.397442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 588/1168] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:09.415833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:09.416339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:09.422119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:09.422562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:09.423343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:09.423771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:09.549745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:09.557744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b59f151b-0955-494c-9ea9-693749f6accb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.146397 Nov 21 17:27:09.558300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 581/1169] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:10.575747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:10.576214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:10.581898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:10.582337 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:10.583125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:10.583552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:10.702900 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:10.710387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-01608dab-6157-4bde-a89d-836f7622237f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139482 Nov 21 17:27:10.710977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 589/1170] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:11.728341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:11.728989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:11.735087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:11.735539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:11.736317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:11.736751 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:11.855998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:11.863558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-464863b3-e297-4a60-b682-893c50ccee4e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139232 Nov 21 17:27:11.864342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 582/1171] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:12.881165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:12.881860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:12.888668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:12.889125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:12.889899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:12.890406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:13.013700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:13.020920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-594b5bc2-412d-4cf0-8f22-fbede2d85cd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143492 Nov 21 17:27:13.021494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 590/1172] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:14.039367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:14.041173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:14.047656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:14.048100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:14.048858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:14.049283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:14.168450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:14.175671 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1eb85091-5079-4f5a-8ed6-cef697700fe6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140262 Nov 21 17:27:14.176238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 583/1173] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:15.192462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:15.193060 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:15.199395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:15.199842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:15.200600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:15.201031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:15.319136 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:15.326612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fa9da33c-4a4f-43b4-b577-4e8c88832c73 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137808 Nov 21 17:27:15.327190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 591/1174] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:16.343819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:16.344534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:16.350288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:16.350768 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:16.351524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:16.351980 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:16.549251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:16.557143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4e049d76-3e84-429a-bd1a-95bf5f7169b6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.216550 Nov 21 17:27:16.557827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 584/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:27:17.574616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:17.575274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:17.581133 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:17.581587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:17.582347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:17.582837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:17.706467 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:17.714844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-89aa0e5a-0010-4ed0-b110-4d4e57e5c338 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144344 Nov 21 17:27:17.715423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 592/1176] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:18.732598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:18.733215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:18.739040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:18.739488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:18.740249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:18.740685 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:18.861709 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:18.869044 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5844ea55-fb1d-42df-9a4a-a4509dda7764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140763 Nov 21 17:27:18.869758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 585/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:19.886218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:19.886878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:19.894073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:19.894765 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:19.895217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:19.895652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:20.020687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:20.028505 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6af14f7a-031a-415a-89d1-27f32619481c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.146104 Nov 21 17:27:20.029068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 593/1178] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:21.046452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:21.047104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:21.053006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:21.053391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:21.054160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:21.054599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:21.173957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:21.181825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ec416f33-259b-45ac-a65a-03bdec1b5098 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139057 Nov 21 17:27:21.182400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 586/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:22.198733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:22.199342 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:22.205076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:22.205514 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:22.206276 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:22.206728 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:22.328089 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:22.335601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-186540b1-9690-4762-a3ae-caa74513d641 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140593 Nov 21 17:27:22.336165 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 594/1180] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:23.353991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:23.354799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:23.360612 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:23.361059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:23.361820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:23.362251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:23.482988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:23.490282 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cd857396-ecb1-4805-b52e-fa2993ae2caf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140542 Nov 21 17:27:23.490877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 587/1181] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:24.508520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:24.509116 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:24.515478 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:24.515918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:24.516663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:24.517085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:24.635597 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:24.642840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-22f25db9-5279-4699-8fb3-38917020f906 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137904 Nov 21 17:27:24.643404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 595/1182] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:25.660521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:25.661138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:25.667102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:25.667544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:25.668295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:25.668723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:25.794876 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:25.802058 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-89989d21-e8bd-4749-b29f-7535d157d829 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.145239 Nov 21 17:27:25.802637 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 588/1183] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:26.818771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:26.819404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:26.825179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:26.825628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:26.826390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:26.826847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:26.949196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:26.956899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0068f5d2-32ee-47a6-80e1-52e7083f1786 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141877 Nov 21 17:27:26.957461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 596/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:27.974989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:27.975594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:27.981984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:27.982433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:27.983231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:27.983665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:28.102257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:28.110084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0ae5baa2-79d7-44ae-b78a-c79d0f0b4c0a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138786 Nov 21 17:27:28.110672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 589/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:29.127439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:29.128022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:29.133821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:29.134264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:29.135043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:29.135474 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:29.257510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:29.265616 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9678f2e7-5906-4e16-a84a-a026a3b9b195 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141819 Nov 21 17:27:29.266181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 597/1186] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:30.283326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:30.284011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:30.289536 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:30.289977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:30.290780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:30.291210 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:30.410223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:30.417526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c5fb60b4-1f62-4c02-b7ab-fa0f880a2ac8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137873 Nov 21 17:27:30.418089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 590/1187] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:31.434749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:31.435284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:31.441145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:31.441594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:31.442361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:31.442828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:31.560948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:31.568509 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2e3e1dfc-cbcd-42d4-8fbe-e03f5d393a90 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137638 Nov 21 17:27:31.569080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 598/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:32.586647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:32.587256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:32.593440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:32.593885 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:32.594661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:32.595097 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:32.717774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:32.725044 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-92805392-fe43-4e90-a4c6-56d80cbce010 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142357 Nov 21 17:27:32.725600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 591/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:33.272108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:27:33.272351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:27:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:27:33.742541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:33.743197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:33.749191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:33.749644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:33.750409 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:33.750887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:33.869609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:33.877442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-725f9e94-3092-4d99-a974-f533255cd277 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138538 Nov 21 17:27:33.878013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 599/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:34.894092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:34.894758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:34.900651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:34.901086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:34.901836 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:34.902258 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:35.025212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:35.032489 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-21392eee-7c50-4d8b-adde-f63455245272 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142099 Nov 21 17:27:35.033048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 592/1191] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:36.050035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:36.050680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:36.056481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:36.056872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:36.057635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:36.058104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:36.179991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:36.188001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f032ed2e-7c7f-4e80-aa29-79587cfc8f06 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141709 Nov 21 17:27:36.188555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 600/1192] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:37.205668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:37.206303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:37.212514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:37.212974 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:37.213718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:37.214150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:37.338787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:37.346681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-32ef5340-54d6-49c4-a3d1-f31218dcd3f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144626 Nov 21 17:27:37.347246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 593/1193] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:38.363803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:38.364408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:38.370179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:38.370650 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:38.371401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:38.372027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:38.488969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:38.497113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a71a1bbe-70a7-4639-bda2-c94639e23926 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.136836 Nov 21 17:27:38.497688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 601/1194] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:39.514359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:39.514938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:39.520691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:39.521154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:39.521910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:39.522343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:39.643747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:39.650985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-67ede448-0039-4f41-864e-bacbc2b3c456 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140597 Nov 21 17:27:39.651547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 594/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:40.668124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:40.669358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:40.675420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:40.675872 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:40.676631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:40.677069 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:40.799945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:40.807464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-060349b9-9c65-4eb3-907a-7b9f3224eeb0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142981 Nov 21 17:27:40.808025 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 602/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:41.826710 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:41.827333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:41.833607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:41.834080 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:41.834879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:41.835571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:41.957900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:41.965443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-71721c2b-5315-4d3b-8b3f-c5efa9d962a3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143588 Nov 21 17:27:41.966568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 595/1197] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:42.983527 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:42.983982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:42.989822 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:42.990212 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:42.991012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:42.991447 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:43.115346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:43.123175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cff116d0-5166-4b0c-ad81-d36e7984eb43 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144034 Nov 21 17:27:43.123742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 603/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:44.140069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:44.140688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:44.146562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:44.147043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:44.147805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:44.148240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:44.267459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:44.274651 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-04edf1df-a157-4f11-8e58-9099b8297594 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138227 Nov 21 17:27:44.275203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 596/1199] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:45.291759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:45.292365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:45.298276 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:45.298756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:45.299521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:45.299952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:45.419945 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:45.427195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2915b3fa-693d-4e8f-8ba0-581731b2d38a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139072 Nov 21 17:27:45.427757 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 604/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:46.445205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:46.445775 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:46.451933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:46.452391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:46.453157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:46.453592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:46.576009 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:46.583255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d88891bd-cd07-4b95-bfc9-de127fad0bce tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141946 Nov 21 17:27:46.583818 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 597/1201] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:47.600919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:47.601557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:47.608301 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:47.608747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:47.609504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:47.609935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:47.729006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:47.737390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-31df8cb3-1068-4d6c-8045-4e57a96668db tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139697 Nov 21 17:27:47.737535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 605/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:48.753558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:48.754172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:48.759989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:48.760440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:48.761200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:48.761670 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:48.880119 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:48.887568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4f71e42b-de49-4366-b752-07e4977a65e3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137542 Nov 21 17:27:48.887972 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 598/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:49.905007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:49.905623 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:49.911735 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:49.912177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:49.912929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:49.913358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:50.035494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:50.042716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6516527c-d9f7-44d7-a672-beae7182891c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.142215 Nov 21 17:27:50.043305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 606/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:51.060045 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:51.060584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:51.066321 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:51.066804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:51.067557 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:51.067982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:51.187395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:51.194602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-88f317eb-311c-446a-a663-2db5a09beeef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138492 Nov 21 17:27:51.195188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 599/1205] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:27:52.212036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:52.212681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:52.218689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:52.219115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:52.219876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:52.220313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:52.339466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:52.346805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2fb7dc7a-7d53-45ea-bc0e-05b18947aa8b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138681 Nov 21 17:27:52.347363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 607/1206] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:53.364531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:53.365128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:53.370983 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:53.371432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:53.372370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:53.372804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:53.497110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:53.504560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6f6180f7-db3e-405f-a60c-e9f56537773d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143722 Nov 21 17:27:53.505131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 600/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:54.521756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:54.522377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:54.529327 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:54.529776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:54.530543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:54.531006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:54.650148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:54.657990 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5878ec39-80f0-49dc-99f4-3de424004cf6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139930 Nov 21 17:27:54.658548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 608/1208] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:55.675743 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:55.676356 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:55.682100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:55.682551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:55.683370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:55.683806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:55.807380 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:55.815471 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-20147413-e6c8-4afb-bf84-aa6a35cc13a2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143389 Nov 21 17:27:55.816036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 601/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:56.832621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:56.833310 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:56.839388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:56.839834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:56.840589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:56.841020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:56.963241 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:56.970522 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dbf2d463-284b-4c9a-a35a-9534ac3cdc29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141556 Nov 21 17:27:56.971435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 609/1210] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:57.987871 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:57.988396 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:57.994180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:57.994637 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:57.995494 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:57.995929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:58.123351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:58.131504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1a256316-0434-42f8-9384-03211b7719fa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.147374 Nov 21 17:27:58.132185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 602/1211] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:27:59.149139 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:27:59.149749 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:27:59.155740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:59.156189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:59.156957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:27:59.157395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:27:59.275378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:27:59.282884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-018578b6-604d-490d-ab64-8b4382733614 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137298 Nov 21 17:27:59.283439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 610/1212] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:27:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:00.300076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:00.300678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:00.306428 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:00.306896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:00.307638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:00.308062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:00.430094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:00.437540 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c154d590-9434-4831-b25f-c940cb5a41af tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141072 Nov 21 17:28:00.438086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 603/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:01.455050 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:01.455642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:01.461712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:01.462162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:01.462944 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:01.463385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:01.581829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:01.589386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5d499b80-9ae0-4ea1-95d9-56ef958e1c67 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138043 Nov 21 17:28:01.589957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 611/1214] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:02.606531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:02.607157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:02.612910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:02.613348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:02.614095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:02.614520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:02.732644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:02.740054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f8d4d0b3-ce48-4cad-b973-3990cb88b43c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137331 Nov 21 17:28:02.740615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 604/1215] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:03.757146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:03.757793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:03.763747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:03.764194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:03.764954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:03.765392 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:03.885656 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:03.893489 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7b2669a7-4e8a-4a18-9a9f-6badbdd0abe8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.139994 Nov 21 17:28:03.894043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 612/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:04.911384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:04.912072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:04.917741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:04.918180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:04.919589 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:04.920087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:05.037580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:05.045520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b896d850-6d04-4ac7-8e23-ea5ca470fa0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137753 Nov 21 17:28:05.046096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 605/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:06.063233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:06.064153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:06.070070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:06.070518 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:06.071318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:06.071753 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:06.189444 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:06.196569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-27357557-73ee-4d95-9ff0-122df8948afa tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137867 Nov 21 17:28:06.197124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 613/1218] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:07.213787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:07.214426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:07.216826 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:28:07.221173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:07.221618 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:07.222369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:07.222840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:07.346127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:07.353441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7d482590-c297-4098-a8e8-79a5c30d5a18 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.143566 Nov 21 17:28:07.353994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 606/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:08.378249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:08.379795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:08.387784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:08.389034 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:08.389913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:08.390419 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:08.513687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:08.521111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f9aacb56-e1d8-4083-b293-0feb2d5d1799 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.148027 Nov 21 17:28:08.521678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 614/1220] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:09.538930 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:09.539523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:09.557075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:09.557525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:09.558294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:09.558762 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:09.563776 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 43082. Nov 21 17:28:09.679645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:09.687108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ce3d4b5-c48d-4fff-a2d3-23c77cf7bcb3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.151733 Nov 21 17:28:09.687687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 607/1221] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:10.702515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:28:10.705764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:10.706390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:10.712695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:10.713079 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:10.713852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:10.714282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:10.839294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:10.847181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7c59a1aa-9b93-4062-8408-36747648c0e5 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.146064 Nov 21 17:28:10.847746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 615/1222] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:11.864246 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:11.864874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:11.870654 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:11.871128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:11.872384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:11.872814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:11.991333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:11.999173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-528932cc-7a9d-4a0a-8777-3dc2fb806557 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.138691 Nov 21 17:28:11.999695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 608/1223] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:13.017030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:13.017639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:13.038994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 43110. Nov 21 17:28:13.041064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:13.041620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:13.042446 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:13.042972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:13.171577 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:13.179151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6eff7e80-8462-4a86-975d-008a0cc87c3d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.166653 Nov 21 17:28:13.179713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 616/1224] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:14.196913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:14.197485 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:14.203910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:14.204346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:14.205090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:14.205516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:14.325976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:14.333749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-203c29d3-94ac-4fc4-b53d-e08e1c1fd9f0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.140545 Nov 21 17:28:14.334289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 609/1225] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:15.351368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:15.352014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:15.358328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:15.358803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:15.359560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:15.360001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:15.480217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:15.488856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aa5ee7f7-1c7f-4cbc-986d-b81deb0d13ed tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.141122 Nov 21 17:28:15.489466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 617/1226] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:16.506771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:16.507386 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:16.513251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:16.514367 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:16.515163 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:16.515606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:16.632606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:16.640342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2ace1f0b-c560-448e-83ad-29d499da0720 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.137291 Nov 21 17:28:16.640908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 610/1227] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:17.658372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:17.658994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:17.664734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:17.665174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:17.665920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:17.666350 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:17.789911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:17.798082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e8459225-745d-4041-bdcd-4c83f32c5c6b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144301 Nov 21 17:28:17.798665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 618/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:18.815702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:18.816316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:18.822426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:18.822914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:18.823705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:18.824140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:18.948292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:18.956810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4aeef473-5326-4289-95e5-0e8c79715a57 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1564 microversion: 2.1 time: 0.144780 Nov 21 17:28:18.957415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 611/1229] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1564 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:19.848278 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:19.848832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:19.861264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:19.862871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:19.863706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:19.864153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:19.890969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:28:19.989231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-12877d89-a602-400a-bc32-1617441387b6 req-766c15cd-70cd-4efd-9925-3c61640c2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:28:19.993616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:28:19.993616 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:28:20.001466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f67a34b1-977e-4948-a39b-728058b2060f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 204 len: 0 microversion: 2.1 time: 0.156809 Nov 21 17:28:20.004284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 619/1230] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:28:19 2021] DELETE /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 21 17:28:20.006102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-12877d89-a602-400a-bc32-1617441387b6 req-766c15cd-70cd-4efd-9925-3c61640c2b7b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:20.006563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-12877d89-a602-400a-bc32-1617441387b6 req-766c15cd-70cd-4efd-9925-3c61640c2b7b service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:20.012767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:20.013648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:20.020209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:20.020653 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:20.021420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:20.021849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:20.025827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-12877d89-a602-400a-bc32-1617441387b6 req-766c15cd-70cd-4efd-9925-3c61640c2b7b service nova] Creating event network-changed:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:28:20.032248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-12877d89-a602-400a-bc32-1617441387b6 req-766c15cd-70cd-4efd-9925-3c61640c2b7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184675 Nov 21 17:28:20.033440 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 612/1231] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:28:20.231284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:20.245435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8a89db8c-e65c-4a83-bd94-ce18eba97d87 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1570 microversion: 2.1 time: 0.236646 Nov 21 17:28:20.246014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 620/1232] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:21.264329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:21.265034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:21.271098 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:21.271551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:21.272318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:21.272754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:21.333600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:21.341475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4c29045d-ecf3-4f9e-b03c-b44b70976af4 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081611 Nov 21 17:28:21.342508 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 613/1233] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:22.048957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-49ff5e73-d363-417c-a73e-256925f996bb req-c33f5a62-0d9b-451f-a5b3-2f0207476413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b0ec33-1901-4e36-b169-9f396631f2b1", "name": "network-vif-deleted", "tag": "a1c02ca3-8c2e-4390-906e-dfaeb4d521c5"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:28:22.050445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:28:22.050445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:28:22.057371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-49ff5e73-d363-417c-a73e-256925f996bb req-c33f5a62-0d9b-451f-a5b3-2f0207476413 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:22.057809 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-49ff5e73-d363-417c-a73e-256925f996bb req-c33f5a62-0d9b-451f-a5b3-2f0207476413 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:22.068926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-49ff5e73-d363-417c-a73e-256925f996bb req-c33f5a62-0d9b-451f-a5b3-2f0207476413 service nova] Creating event network-vif-deleted:a1c02ca3-8c2e-4390-906e-dfaeb4d521c5 for instance 62b0ec33-1901-4e36-b169-9f396631f2b1 on hv-cinder-81869 Nov 21 17:28:22.074049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-49ff5e73-d363-417c-a73e-256925f996bb req-c33f5a62-0d9b-451f-a5b3-2f0207476413 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028964 Nov 21 17:28:22.074656 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 621/1234] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:28:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:28:22.359451 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:22.360054 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:22.365852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:22.366293 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:22.367090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:22.367522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:22.428741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:22.437740 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e3f66f0a-b3ca-4f86-a9c0-e891265b3dd7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083041 Nov 21 17:28:22.438304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 614/1235] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:23.077468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:28:23.078032 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:28:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:28:23.456163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:23.456874 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:23.463700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:23.464140 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:23.464924 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:23.465346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:23.528804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:23.536878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e6566b33-6f0e-4a2f-ab3d-07d3559284f2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.085876 Nov 21 17:28:23.537434 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 622/1236] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:23 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:24.553856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:24.554541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:24.560116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:24.560587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:24.561307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:24.561761 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:24.623861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:24.631053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6a21a044-8d68-43a6-87ed-783c51d583a8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080858 Nov 21 17:28:24.631606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 615/1237] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:25.647674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:25.648339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:25.654233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:25.654700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:25.655454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:25.655881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:25.713982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:25.721689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f32f31d3-c2b8-42ca-9267-7f9045ae5d3e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077624 Nov 21 17:28:25.722260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 623/1238] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:26.738816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:26.739421 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:26.745239 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:26.745679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:26.746428 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:26.746879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:26.805623 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:26.813716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-708fb173-0ab5-4b4e-be0c-3f3b89c2a78e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078489 Nov 21 17:28:26.814298 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 616/1239] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:27.830640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:27.831229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:27.837263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:27.837708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:27.838462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:27.838912 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:27.897206 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:27.904516 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-81562200-496b-4f7d-806f-40f50dfbee50 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077658 Nov 21 17:28:27.905076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 624/1240] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:28.920676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:28.921248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:28.927117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:28.927559 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:28.928319 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:28.929412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:28.990453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:28.998674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9b03bd05-3f49-495a-8877-7230a1bab2c0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080869 Nov 21 17:28:28.999707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 617/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:30.016092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:30.016700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:30.022358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:30.022838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:30.023594 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:30.024023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:30.083712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:30.091259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-45013a78-d4dd-47b2-a50a-c83eceaea56d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079446 Nov 21 17:28:30.092992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 625/1242] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:31.109652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:31.110274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:31.116417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:31.116880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:31.117665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:31.118103 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:31.184189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:31.192036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-096bb1ec-232d-4b66-90cf-315cd7e228d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.086542 Nov 21 17:28:31.192607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 618/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:32.209175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:32.209782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:32.215851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:32.216343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:32.217091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:32.217521 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:32.277090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:32.285001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1e3f99f6-6fd5-4e34-bce0-f595371a010b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079502 Nov 21 17:28:32.285547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 626/1244] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:28:33.302548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:33.303109 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:33.308945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:33.309394 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:33.310675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:33.311113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:33.369937 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:33.378047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d6a608cb-96f6-4e44-8278-86fc3f9b7021 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079318 Nov 21 17:28:33.378611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 619/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:34.394756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:34.395369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:34.401151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:34.401603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:34.402364 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:34.402834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:34.460879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:34.469058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f4184189-551d-4d6e-a88a-baf092b88314 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077958 Nov 21 17:28:34.469604 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 627/1246] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:34 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:35.486056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:35.486726 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:35.492526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:35.492978 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:35.493736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:35.494173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:35.552602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:35.559864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f3314440-16e0-4840-a61d-dc46d6acd45a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078140 Nov 21 17:28:35.560571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 620/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:36.577510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:36.578219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:36.584195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:36.584649 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:36.585434 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:36.585871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:36.647117 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:36.655411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-56ddc7b2-25f1-4063-a5f6-d732f644682d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.082135 Nov 21 17:28:36.655991 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 628/1248] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:37.672902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:37.673546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:37.679447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:37.679901 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:37.680659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:37.681095 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:37.984856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:37.992259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1b697fd7-2ff4-4612-8e3d-54c92f46d79c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.323657 Nov 21 17:28:37.992828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 621/1249] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:28:39.009513 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:39.010143 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:39.016403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:39.016858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:39.017628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:39.018058 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:39.077732 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:39.085352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bf97cd09-c859-4ab0-8f01-a8302253e586 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079606 Nov 21 17:28:39.085933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 629/1250] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:40.102874 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:40.103456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:40.109933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:40.110369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:40.111154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:40.111577 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:40.172580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:40.180093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d4d79448-6f36-421e-ab4d-28593d114405 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081030 Nov 21 17:28:40.180674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 622/1251] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:41.197033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:41.197671 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:41.204085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:41.204555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:41.205323 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:41.205755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:41.267161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:41.274393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8e6c5fd3-47ef-490a-8d0f-9b7152cd0ccc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081048 Nov 21 17:28:41.274997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 630/1252] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:42.292154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:42.292752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:42.299419 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:42.299868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:42.300630 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:42.301064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:42.364192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:42.371786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-080784ca-f360-42dd-a97e-9794e4af7530 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083261 Nov 21 17:28:42.372514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 623/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:43.388853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:43.389461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:43.395272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:43.395724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:43.396485 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:43.396916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:43.457640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:43.465577 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-75bc78a3-1457-4724-887e-8af18b87b63d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080420 Nov 21 17:28:43.466156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 631/1254] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:44.548938 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:44.549551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:44.555302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:44.555745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:44.556500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:44.556934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:44.617211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:44.624805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c15056b5-89b3-4d4b-9556-0d6fe4be37d8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.146583 Nov 21 17:28:44.625373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 624/1255] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:45.642445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:45.643096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:45.648813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:45.649254 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:45.650002 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:45.650425 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:45.709574 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:45.717438 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fe5e0e65-927e-43eb-ad5c-a695e2cdb628 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080191 Nov 21 17:28:45.718013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 632/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:46.733392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:46.733992 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:46.739834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:46.740271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:46.741025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:46.741443 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:46.799159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:46.806166 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e07eb99a-abb4-4a4c-beff-09801bb42c1e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.076610 Nov 21 17:28:46.806740 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 625/1257] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:46 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:47.823171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:47.823767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:47.830112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:47.830549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:47.831324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:47.831751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:47.890201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:47.897413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-47b06d5d-70b4-4a99-b019-42d8907c133c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077905 Nov 21 17:28:47.897971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 633/1258] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:48.915175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:48.915697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:48.922004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:48.922449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:48.923242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:48.923672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:48.985242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:48.992548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-04d97cd7-5913-4892-a20c-ded6c56f8a3c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081147 Nov 21 17:28:48.993110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 626/1259] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:50.008859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:50.009410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:50.015455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:50.015905 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:50.016670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:50.017107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:50.075629 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:50.083261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ae0c7009-48f3-4c5c-9652-657ffa278814 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078172 Nov 21 17:28:50.083838 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 634/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:51.101190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:51.101813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:51.107737 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:51.108227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:51.108978 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:51.109406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:51.169180 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:51.176499 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-edd5c43b-5152-4d5b-b3f9-0d4a915e3838 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078973 Nov 21 17:28:51.177056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 627/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:52.193236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:52.193784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:52.199599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:52.200054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:52.200812 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:52.201324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:52.259762 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:52.267245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d1e4a20c-aa58-41a2-b4ae-f10ec732fc69 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077778 Nov 21 17:28:52.267814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 635/1262] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:53.284934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:53.285514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:53.291278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:53.291730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:53.292495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:53.292928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:53.352800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:53.360126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f148736a-c0fe-41cb-a735-5a6b30128d83 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079093 Nov 21 17:28:53.360684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 628/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:54.376403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:54.377014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:54.382890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:54.383341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:54.384099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:54.384535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:54.442535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:54.449591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b9108864-a9e6-45bb-b8d8-835ea6f79f36 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.076889 Nov 21 17:28:54.450135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 636/1264] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:55.467850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:55.468487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:55.474205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:55.474664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:55.475705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:55.476131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:55.539848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:55.547304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6437bb9f-adbb-462d-a34a-6c3398dd5ca7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083808 Nov 21 17:28:55.547866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 629/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:56.564035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:56.564716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:56.570539 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:56.571020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:56.571780 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:56.572216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:56.632225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:56.639530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7bc1aff8-0f79-4589-b5ce-011230828b3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079264 Nov 21 17:28:56.640092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 637/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:57.656864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:57.657481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:57.663345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:57.663793 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:57.664546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:57.664977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:57.726068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:57.733430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cf1de938-c92d-42cf-b004-60e38b5fa764 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080262 Nov 21 17:28:57.734053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 630/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:58.751453 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:58.752111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:58.757914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:58.758358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:58.759157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:58.759593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:58.819916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:58.827195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-124c3797-f187-4d1e-b943-c9101b84859c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079954 Nov 21 17:28:58.827803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 638/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:58 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:28:59.845615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:28:59.846213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:28:59.852015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:59.852456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:59.853199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:28:59.853627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:28:59.913918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:28:59.921140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fdd0378c-edf3-4942-867e-7b3b171f4bac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079895 Nov 21 17:28:59.921941 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 631/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:28:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:00.937214 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:00.937881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:00.943699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:00.944145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:00.944907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:00.945328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:01.005377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:01.012711 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-354e0d82-8639-411b-8155-647b38eecdd8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079334 Nov 21 17:29:01.013361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 639/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:02.029522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:02.030055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:02.036117 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:02.036568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:02.037336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:02.037776 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:02.101805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:02.109587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d3bd184f-cc86-433b-b0c2-e8e4de9c996b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083242 Nov 21 17:29:02.110270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 632/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:03.126541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:03.127195 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:03.132951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:03.133399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:03.134155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:03.134589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:03.193542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:03.200817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ed78514e-0697-44f8-92f5-b5cadf0357bd tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078108 Nov 21 17:29:03.201378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 640/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:04.217929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:04.218544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:04.224402 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:04.224851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:04.225619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:04.226052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:04.285945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:04.293363 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ea5e244-8681-4e58-a43b-d11171ff1a08 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079119 Nov 21 17:29:04.293925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 633/1273] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:05.310598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:05.311232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:05.317639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:05.318091 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:05.318869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:05.319307 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:05.378439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:05.385667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7e0d2b8f-472e-4784-965d-0fae6275bec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078732 Nov 21 17:29:05.386224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 641/1274] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:06.403239 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:06.403829 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:06.410404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:06.410886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:06.411648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:06.412089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:06.470942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:06.478110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7f9aff39-8ecc-48bd-ada9-63b79172a01f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078524 Nov 21 17:29:06.478687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 634/1275] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:07.495511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:07.496114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:07.502595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:07.503179 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:07.504088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:07.504555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:07.565708 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:07.573067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ff993bf0-283b-4651-ba2a-3eebefb7f00b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081507 Nov 21 17:29:07.573618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 642/1276] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:08.590551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:08.591142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:08.596893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:08.597335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:08.598114 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:08.598543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:08.789837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:08.798140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-67d6e8d4-31a3-4d4b-bb71-6c2dda62a35d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.211154 Nov 21 17:29:08.798519 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 635/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:09.814887 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:09.815505 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:09.821613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:09.822065 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:09.822868 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:09.823389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:09.892102 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:09.899288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c61a83b0-093f-467c-bcfe-0b2aa6d64d9e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.088255 Nov 21 17:29:09.899850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 643/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:10.916039 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:10.916645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:10.923129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:10.923608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:10.924385 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:10.924816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:10.984417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:10.991850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-618b0b30-216f-494b-b30c-7b116c71a21c tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079393 Nov 21 17:29:10.992345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 636/1279] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:10 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:12.008360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:12.008979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:12.014600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:12.015085 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:12.015847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:12.016291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:12.075925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:12.083927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-500e67c8-c01e-4d02-a3ca-3c9ce69bc0d6 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079128 Nov 21 17:29:12.084502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 644/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:13.100913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:13.101522 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:13.107337 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:13.107788 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:13.108541 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:13.110167 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:13.169425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:13.177223 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7847ae26-9cae-49d6-bc08-9dacdc72ce16 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080007 Nov 21 17:29:13.177783 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 637/1281] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:14.193986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:14.194510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:14.200346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:14.200791 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:14.201546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:14.201980 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:14.309170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:14.317238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8f84ed2b-d2ff-4c3a-80c5-d459f4615b29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.127090 Nov 21 17:29:14.317864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 645/1282] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:15.335005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:15.335594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:15.342310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:15.342797 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:15.344107 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:15.344537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:15.407534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:15.415445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-66890e4b-e762-4eee-8ebe-8586c9985f7d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083945 Nov 21 17:29:15.416075 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 638/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:29:16.432703 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:16.433269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:16.439739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:16.440183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:16.440942 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:16.441369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:16.500084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:16.507803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-de72c794-e5d2-49d7-bf3a-ef11fbc42302 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078921 Nov 21 17:29:16.508360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 646/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:17.181567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:29:17.181797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:29:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:29:17.525032 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:17.525563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:17.531625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:17.532071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:17.532834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:17.533274 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:17.595233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:17.602598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-36cb15d2-3b10-45cf-9a46-a715dcb0c7a0 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081305 Nov 21 17:29:17.603183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 639/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:18.620176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:18.620778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:18.627244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:18.627688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:18.628436 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:18.628873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:18.688622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:18.695724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6146a06d-c522-47d8-825a-02cbf566aec3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079220 Nov 21 17:29:18.696274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 647/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:19.712746 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:19.713335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:19.719977 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:19.720427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:19.721200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:19.721638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:19.784607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:19.791980 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4448e129-f836-495a-bcb6-070d7a2264dc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083191 Nov 21 17:29:19.792537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 640/1287] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:20.808940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:20.809543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:20.815569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:20.816013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:20.816767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:20.817196 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:20.876249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:20.883526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e9b88607-a39b-4034-bc7e-189f58512a4d tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078297 Nov 21 17:29:20.884076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 648/1288] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:21.900817 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:21.901424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:21.907511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:21.907957 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:21.908704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:21.909159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:21.970995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:21.978192 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c9be62b8-003d-4769-8b30-14caefc051e1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081050 Nov 21 17:29:21.978778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 641/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:21 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:22.994777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:22.995336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:23.001816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:23.002261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:23.003056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:23.003491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:23.065096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:23.072333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0517006e-d596-49bd-8ad5-008b3355b680 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081278 Nov 21 17:29:23.072895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 649/1290] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:24.090154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:24.090757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:24.097241 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:24.097680 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:24.098427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:24.098884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:24.157198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:24.164298 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-397ca01d-e987-4560-ba0f-d27a7bda56ea tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078388 Nov 21 17:29:24.164856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 642/1291] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:24 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:25.181684 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:25.182281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:25.188626 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:25.189064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:25.189808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:25.190233 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:25.248543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:25.256536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0e071a86-052a-4e94-a9ae-11833eafffe1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078477 Nov 21 17:29:25.257094 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 650/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:25 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:29:26.272563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:26.273160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:26.279010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:26.279453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:26.280197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:26.280796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:26.342847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:26.350684 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3bbd0065-2de6-4d6d-a721-3762642504c2 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081658 Nov 21 17:29:26.351261 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 643/1293] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:26 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:27.367777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:27.368390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:27.374063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:27.375152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:27.375931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:27.376366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:27.434067 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:27.442013 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f4471e5d-588c-494c-bd5c-90dca462ae0b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077850 Nov 21 17:29:27.442567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 651/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:27 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:28.459200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:28.459834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:28.465805 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:28.466245 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:28.467025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:28.467453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:28.531752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:28.539036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ddf90f1c-a12f-4577-a36c-ef5d30fb3331 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083461 Nov 21 17:29:28.539605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 644/1295] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:28 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:29.554830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:29.555438 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:29.561176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:29.561624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:29.562495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:29.562956 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:29.621789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:29.629129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e7303ab2-b978-434f-9a67-29edd6cd9ebf tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077898 Nov 21 17:29:29.629689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 652/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:29 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:30.645933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:30.646531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:30.652328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:30.652766 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:30.653515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:30.653940 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:30.712165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:30.720511 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-42613b3e-7e9d-4d00-86d9-e1118c855d3f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078269 Nov 21 17:29:30.721086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 645/1297] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:30 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:31.736983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:31.737629 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:31.743666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:31.744115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:31.744906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:31.745339 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:31.803879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:31.811012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2c1da4cf-0bfb-4bd4-9262-2d80cc3b225b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077676 Nov 21 17:29:31.811566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 653/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:31 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:32.829215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:32.829830 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:32.835714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:32.836160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:32.836920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:32.837602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:32.897078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:32.904304 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-614dcc81-c6e6-4b25-98a8-fa2876d5491a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079423 Nov 21 17:29:32.904869 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 646/1299] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:32 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:33.922135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:33.922700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:33.928550 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:33.929001 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:33.929890 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:33.930199 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:33.989151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:33.996329 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0bc17578-c02a-4106-bd11-196789bb950a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078522 Nov 21 17:29:33.996886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 654/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:33 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:35.013323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:35.013912 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:35.019941 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:35.020392 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:35.021159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:35.021599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:35.084880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:35.092387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1f4e3367-d92d-4c17-86e3-0aee821a56c7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.082822 Nov 21 17:29:35.093020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 647/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:35 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:36.109585 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:36.110191 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:36.116010 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:36.116450 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:36.117197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:36.117622 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:36.175929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:36.183070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9f997395-2f9a-4615-8798-c33bf06f949a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077738 Nov 21 17:29:36.183621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 655/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:36 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:37.199673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:37.200309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:37.206153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:37.206600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:37.207387 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:37.207823 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:37.266944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:37.274232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ada02867-1e4b-4584-8e59-ee6773a2cc3b tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078184 Nov 21 17:29:37.274825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 648/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:37 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:38.291374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:38.291975 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:38.298347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:38.298830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:38.299589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:38.300017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:38.359502 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:38.366725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b903a873-3a48-4075-a85b-91fdb1e4fafc tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078964 Nov 21 17:29:38.367291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 656/1304] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:38 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:39.384493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:39.385100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:39.390856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:39.391305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:39.392079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:39.392486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:39.451504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:39.458953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f2c7e3b8-d71b-452a-ba35-323bfeee0b55 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078189 Nov 21 17:29:39.459555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 649/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:39 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:40.476365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:40.476970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:40.482959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:40.483406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:40.484402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:40.484832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:40.547149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:40.555582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e913758f-d014-46eb-b460-b8f5c0d90765 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083033 Nov 21 17:29:40.556162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 657/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:40 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:41.572226 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:41.572833 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:41.579765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:41.580201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:41.580973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:41.581406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:41.647429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:41.654676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-44b8f386-1b2f-4925-88ff-25a2e914edff tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.086173 Nov 21 17:29:41.655228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 650/1307] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:41 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:42.671700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:42.672236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:42.677876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:42.678316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:42.679098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:42.679524 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:42.739160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:42.746417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0fe61bf6-1986-4b2d-8b76-a1ae39780371 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078545 Nov 21 17:29:42.746995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 658/1308] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:42 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:43.764066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:43.764702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:43.770599 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:43.771072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:43.771895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:43.772268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:43.833401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:43.840954 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bb7bc374-cba2-4d3e-8f43-c84766167ca8 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080746 Nov 21 17:29:43.841517 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 651/1309] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:43 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:44.859679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:44.860341 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:44.866357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:44.866844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:44.867609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:44.868043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:44.927422 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:44.934755 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-13cf9f38-42fa-4fe9-b662-b204e69aa290 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079259 Nov 21 17:29:44.935322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 659/1310] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:44 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:45.952059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:45.953569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:45.959430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:45.959877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:45.960668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:45.961056 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:46.019748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:46.027000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-55cb587d-2b24-4830-80dc-975bb2a861c9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078533 Nov 21 17:29:46.027558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 652/1311] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:45 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:47.044740 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:47.045305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:47.051844 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:47.052283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:47.053030 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:47.053458 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:47.111859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:47.119004 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-90a54379-4d17-4323-ad65-c173c7d609a9 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078117 Nov 21 17:29:47.119559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 660/1312] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:47 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:48.137405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:48.138016 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:48.144254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:48.144698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:48.145455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:48.145889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:48.208752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:48.216292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d226dedc-a455-4ba3-ba0b-1918f86e3696 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.082520 Nov 21 17:29:48.216859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 653/1313] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:48 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:49.233725 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:49.234445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:49.240283 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:49.240677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:49.241439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:49.241876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:49.302581 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:49.309973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-27c0f2da-3e27-4d0d-b559-a74619199b7a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079991 Nov 21 17:29:49.310533 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 661/1314] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:49 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:50.326156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:50.326719 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:50.333161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:50.333608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:50.334366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:50.334840 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:50.393127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:50.400265 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c184a9ae-cde6-4c54-af87-622a3b36daef tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077842 Nov 21 17:29:50.400830 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 654/1315] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:50 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:51.417072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:51.417609 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:51.423525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:51.423973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:51.424729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:51.425162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:51.483076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:51.490363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fda92050-b7c2-426f-be73-96b9fe71d068 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077015 Nov 21 17:29:51.490954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 662/1316] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:51 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:52.507229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:52.507797 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:52.513539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:52.513988 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:52.515399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:52.515834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:52.573326 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:52.581306 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-17252caf-824e-4654-801b-bbb0c9cdef27 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078024 Nov 21 17:29:52.581864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 655/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:52 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:53.598970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:53.599566 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:53.605355 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:53.605805 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:53.606561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:53.607023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:53.667017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:53.674393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-21029e7f-39ca-4765-a2bb-8b8f1d9fcd00 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079090 Nov 21 17:29:53.674969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 663/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:53 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:29:54.690928 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:54.691546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:54.697437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:54.697893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:54.698669 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:54.699106 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:54.763045 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:54.771283 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dc846f17-51ed-4e61-ae66-e972822e6b54 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.083951 Nov 21 17:29:54.771837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 656/1319] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:54 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:55.787952 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:55.788551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:55.794189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:55.794642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:55.795393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:55.796523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:55.853994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:55.861982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3f30cad4-8a6c-4071-853c-61db4a45f4ec tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077468 Nov 21 17:29:55.863015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 664/1320] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:55 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:56.878504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:56.879135 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:56.884809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:56.885251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:56.885995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:56.886421 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:56.944487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:56.951668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-311066bd-a721-49ec-b5da-e0b0d8d28ee1 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.076737 Nov 21 17:29:56.952741 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 657/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:56 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:57.968680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:57.969313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:57.975180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:57.975621 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:57.976362 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:57.976790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:58.034919 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:58.042036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0530ed60-7420-4fcb-bffc-b37338366345 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077432 Nov 21 17:29:58.042578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 665/1322] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:57 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:29:59.059234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:29:59.059795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:29:59.066012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:59.066470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:59.067255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:29:59.067689 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:29:59.126005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:29:59.133348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-acced2f8-368c-4d46-92ba-ea63d4b43c4f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077783 Nov 21 17:29:59.133917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 658/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:29:59 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:00.150686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:00.151347 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:00.157168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:00.157626 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:00.158431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:00.158889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:00.217038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:00.224381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b8838d92-d746-4681-872e-e6d5364e2668 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077523 Nov 21 17:30:00.224935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 666/1324] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:00 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:01.241729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:01.242318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:01.248594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:01.249379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:01.250012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:01.250442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:01.314687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:01.321851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-746b092b-4581-4cd0-a8a9-bb6e8929de09 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.084343 Nov 21 17:30:01.322406 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 659/1325] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:01 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:02.339228 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:02.339882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:02.346368 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:02.346850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:02.347610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:02.348076 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:02.405955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:02.413142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d0fd8f82-6741-4553-a833-49122ef26d2f tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077817 Nov 21 17:30:02.413696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 667/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:02 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:03.430533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:03.431220 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:03.437564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:03.438003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:03.438779 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:03.439208 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:03.498383 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:03.506437 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c1d36365-0c18-443e-b7fc-c7e1c32cccc7 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079479 Nov 21 17:30:03.508622 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 660/1327] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:03 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:04.525122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:04.525694 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:04.532181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:04.532639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:04.533472 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:04.533848 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:04.595456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:04.602520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a24ec42c-1c72-4fcc-ab41-9d7c17cff52a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081181 Nov 21 17:30:04.603110 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 668/1328] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:04 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:05.620228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:05.620837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:05.626786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:05.627244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:05.628005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:05.628441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:05.686404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:05.693538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0cff4333-aa8e-4c1c-91dc-b69629d3f6de tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.076931 Nov 21 17:30:05.694102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 661/1329] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:05 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:06.710688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:06.711292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:06.717356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:06.718309 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:06.719238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:06.719663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:06.777200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:06.784879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-258d9061-352b-43de-8186-3a768299c141 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.077834 Nov 21 17:30:06.785440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 669/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:06 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:07.801190 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:07.801790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:07.807521 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:07.807969 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:07.808717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:07.809142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:07.871479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:07.879244 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-66eec5a4-1c02-4589-b43d-a8438d5bca6a tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081814 Nov 21 17:30:07.879801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 662/1331] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:07 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:08.896568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:08.897173 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:08.903589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:08.904038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:08.904793 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:08.905886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:08.967235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:08.975387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3bd9067d-7f23-49dd-bd2b-725d1daf56ac tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.082469 Nov 21 17:30:08.975948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 670/1332] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:08 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:09.992328 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:09.992875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:09.999296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:09.999828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:10.000596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:10.001033 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:10.061949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:10.069151 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3a747c4c-0fe2-489d-b5d8-bcf843706619 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080599 Nov 21 17:30:10.069706 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 663/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:09 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:11.086486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:11.087130 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:11.094019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:11.094468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:11.095267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:11.095697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:11.153545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:11.161657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9beca476-a04c-4566-a2f8-514e70cc47d3 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078830 Nov 21 17:30:11.162208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 671/1334] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:11 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:12.178271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:12.178903 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:12.184639 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:12.185078 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:12.185822 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:12.186787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:12.245570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:12.253850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bbd6e257-e81c-46e5-8dd5-e77a776ebf29 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079212 Nov 21 17:30:12.254412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 664/1335] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:12 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:13.270720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:13.271356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:13.277108 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:13.277550 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:13.278303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:13.278768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:13.340330 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:13.347808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1812cfe8-b955-425e-ada5-074aa1231008 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080851 Nov 21 17:30:13.348288 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 672/1336] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:13 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:14.364679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:14.365288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:14.372613 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:14.373276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:14.375389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:14.375842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:14.445787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:14.453757 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ef1a2d9c-a2cb-46d6-8117-c5ae42684394 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.092734 Nov 21 17:30:14.454314 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 665/1337] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:14 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:15.470381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:15.471029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:15.477084 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:15.477583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:15.478390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:15.478861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:15.540227 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:15.548086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f67be650-574a-4f78-ad9c-a4f81129b466 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.081695 Nov 21 17:30:15.548644 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 673/1338] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:15 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:16.564734 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:16.565339 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:16.571486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:16.571939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:16.572714 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:16.573303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:16.632553 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:16.640451 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-784cfff4-6daa-41b9-80e4-cf778a5c009e tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079992 Nov 21 17:30:16.641033 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 666/1339] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:16 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:17.657934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:17.658532 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:17.664408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:17.664849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:17.665610 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:17.666014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:17.725114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:17.732319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-77926967-be1c-4b24-a096-264bd3679c47 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.078972 Nov 21 17:30:17.732877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 674/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:17 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:18.749563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:18.750170 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:18.756017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:18.756469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:18.757222 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:18.757655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:18.817296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:18.824584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e1b798e1-b875-46c6-9870-adf7d7476e92 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.079233 Nov 21 17:30:18.825142 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 667/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:18 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:19.841955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:19.843152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:19.848921 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:19.849363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:19.850113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:19.850536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:19.911794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:19.919072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0c8e3797-ab72-4eed-9b99-9f90c582dbdb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.080964 Nov 21 17:30:19.919626 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 675/1342] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:19 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:20.935861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:20.937195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:20.943510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:20.943893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:20.944663 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:20.945096 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:21.010804 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97f9e20e2721402ab9c1d38e3920f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1faf1efb9b549ae90cdf14b0e48e7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:30:21.019661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-99dfa8e1-9043-4273-9547-d353520d9a80 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 200 len: 1220 microversion: 2.1 time: 0.087676 Nov 21 17:30:21.020251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 668/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:20 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:30:22.036498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:22.037104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] [instance: 62b0ec33-1901-4e36-b169-9f396631f2b1] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:30:22.042893 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:22.043338 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:22.044090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:30:22.044517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:30:22.057100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] HTTP exception thrown: Instance 62b0ec33-1901-4e36-b169-9f396631f2b1 could not be found. Nov 21 17:30:22.057673 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Returning 404 to user: Instance 62b0ec33-1901-4e36-b169-9f396631f2b1 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:30:22.058466 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-40b791fa-a02a-4213-b021-4ff42100ad74 tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1" status: 404 len: 111 microversion: 2.1 time: 0.025648 Nov 21 17:30:22.059005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 676/1344] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:30:22 2021] GET /compute/v2.1/servers/62b0ec33-1901-4e36-b169-9f396631f2b1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:30:22.216230 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a53fa209-c567-474d-89f9-9c938b9280eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] Calling method '.version_select at 0x7f1fbd7dd790>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:30:22.235121 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a53fa209-c567-474d-89f9-9c938b9280eb tempest-TestShelveInstance-89777491 tempest-TestShelveInstance-89777491-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1014011852" status: 202 len: 0 microversion: 2.1 time: 0.022825 Nov 21 17:30:22.235695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 669/1345] 10.222.0.52 () {58 vars in 1253 bytes} [Sun Nov 21 17:30:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1014011852 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:30:53.289790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:30:53.290574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:30:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:31:14.364985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:31:14.365667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:31:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:31:15.851272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:31:15.854520 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:15.855039 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:15.860988 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:15.861429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:15.862175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:15.862599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:15.886107 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:31:15.943810 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [32e87077-4284-42af-af55-174982237296] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 17:31:16.867048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44504. Nov 21 17:31:16.958434 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [32e87077-4284-42af-af55-174982237296] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44506. Nov 21 17:31:16.977806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e1048ec1-2b70-46cf-867d-ae65d990d555 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 204 len: 0 microversion: 2.1 time: 1.127787 Nov 21 17:31:16.978471 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 677/1346] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:31:15 2021] DELETE /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 0 bytes in 1129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:31:16.986002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:31:16.989288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:16.989896 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:16.996381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:16.996834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:16.997596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:16.998038 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:17.122600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:17.131357 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-34e79e70-23c8-4441-90c9-eea13727593b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1560 microversion: 2.1 time: 0.148340 Nov 21 17:31:17.131918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 670/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:16 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:18.149501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:18.150200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:18.156972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:18.157428 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:18.158194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:18.158643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:18.198989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-7be67453-3f6b-4820-8bda-e916e4a3089b req-c0faf776-3648-41e6-99bc-ccebe3c3923c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04b8ac9-3c74-4720-9ee3-03113212ad92", "name": "network-vif-deleted", "tag": "53c311bf-339e-4705-b6f4-56ccfbfdc9e3"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:31:18.200645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:31:18.200645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:31:18.219882 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7be67453-3f6b-4820-8bda-e916e4a3089b req-c0faf776-3648-41e6-99bc-ccebe3c3923c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:18.220317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7be67453-3f6b-4820-8bda-e916e4a3089b req-c0faf776-3648-41e6-99bc-ccebe3c3923c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:18.230597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44522. Nov 21 17:31:18.234582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:18.235194 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-7be67453-3f6b-4820-8bda-e916e4a3089b req-c0faf776-3648-41e6-99bc-ccebe3c3923c service nova] Creating event network-vif-deleted:53c311bf-339e-4705-b6f4-56ccfbfdc9e3 for instance d04b8ac9-3c74-4720-9ee3-03113212ad92 on hv-cinder-81869 Nov 21 17:31:18.241317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-7be67453-3f6b-4820-8bda-e916e4a3089b req-c0faf776-3648-41e6-99bc-ccebe3c3923c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046295 Nov 21 17:31:18.241933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 671/1348] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:31:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:31:18.242668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e6604deb-aaf1-4353-9136-9f115f427e61 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1518 microversion: 2.1 time: 0.097187 Nov 21 17:31:18.243230 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 678/1349] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:18 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1518 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:19.260447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:19.261165 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:19.267272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:19.267713 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:19.268454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:19.268879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:19.327918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:19.335405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c6759681-d58c-4f84-9b95-fd8af24303f4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079010 Nov 21 17:31:19.335951 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 672/1350] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:19 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:20.352371 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:20.352984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:20.358829 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:20.359275 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:20.360068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:20.360496 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:20.421221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:20.428831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-970e4856-656d-4d71-94ee-b2a6cfe712bd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080145 Nov 21 17:31:20.429380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 679/1351] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:20 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:21.446062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:21.446717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:21.453048 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:21.453488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:21.454232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:21.454688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:21.512863 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:21.521197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-28c296b1-b06b-4bab-9520-68d9c4c99e4f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078779 Nov 21 17:31:21.521750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 673/1352] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:21 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:22.538885 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:22.539494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:22.545302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:22.546382 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:22.547158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:22.547591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:22.606270 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:22.614570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8d7521db-8754-4c08-8877-e2309449f4b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079331 Nov 21 17:31:22.615151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 680/1353] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:22 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:23.631548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:23.632154 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:23.637961 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:23.638397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:23.639198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:23.640207 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:23.698906 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:23.707033 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-aad257b2-8b88-4ef6-958e-650e0be5e480 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079138 Nov 21 17:31:23.707704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 674/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:23 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:24.724707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:24.725380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:24.731265 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:24.731715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:24.732475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:24.732917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:24.791737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:24.800265 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1bd57b74-3e65-4a6f-a343-0a6e758d4b90 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079242 Nov 21 17:31:24.800824 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 681/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:24 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:25.817944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:25.818551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:25.824351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:25.824803 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:25.825530 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:25.825954 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:25.885353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:25.892887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-47bb07fe-60a8-4651-a2a6-b37c2ba3a60e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078535 Nov 21 17:31:25.893441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 675/1356] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:25 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:26.910366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:26.911000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:26.916780 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:26.917221 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:26.917967 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:26.918394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:26.980366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:26.988115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0538b943-6436-477b-94b3-e7f07e05bbe9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081312 Nov 21 17:31:26.988611 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 682/1357] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:26 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:28.004866 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:28.005480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:28.011327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:28.011778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:28.012575 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:28.013015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:28.072172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:28.080700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dd48c9f2-abfd-4900-a3c5-5c6b5971015c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079525 Nov 21 17:31:28.081250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 676/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:28 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:29.098561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:29.099203 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:29.104972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:29.105424 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:29.106180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:29.106613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:29.166551 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:29.174406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dd1bb016-cbb6-449b-9930-27d4025d2a87 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079501 Nov 21 17:31:29.174996 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 683/1359] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:29 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:30.191707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:30.192316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:30.198059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:30.198514 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:30.199300 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:30.199759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:30.258148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:30.266586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c9d6f906-3c65-4b2d-ae78-983df1210562 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078603 Nov 21 17:31:30.267169 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 677/1360] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:30 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:31.284517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:31.285159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:31.290950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:31.291400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:31.292162 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:31.292596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:31.351111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:31.358821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cc587bab-6e42-45b3-a0bc-a484fb53a050 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078626 Nov 21 17:31:31.359379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 684/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:31 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:32.375663 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:32.376310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:32.382842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:32.383285 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:32.384037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:32.384461 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:32.442645 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:32.450087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-708199ed-5cc2-48a8-914a-c000b515ea12 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078726 Nov 21 17:31:32.450658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 678/1362] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:32 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:33.467186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:33.467916 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:33.473717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:33.474161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:33.474941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:33.475376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:33.538853 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:33.547402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-5e2a1ce1-acad-45b3-921b-47a3c4f3d625 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.084093 Nov 21 17:31:33.547969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 685/1363] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:33 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:34.564224 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:34.564769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:34.570504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:34.570985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:34.571781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:34.572203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:34.633453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:34.641997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-01d3d309-456c-45bd-8b2e-b5c6d51193f0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082045 Nov 21 17:31:34.642572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 679/1364] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:34 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:35.658821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:35.659439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:35.665148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:35.665595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:35.666412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:35.666876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:35.726464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:35.734908 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-76478a7b-84c5-454b-9746-7757e5ae703d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079829 Nov 21 17:31:35.735472 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 686/1365] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:35 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:36.737586 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:36.737990 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:36.743233 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.743677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.744425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.744849 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.752172 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:36.752777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:36.758542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.759017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.759370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. Nov 21 17:31:36.759771 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.759948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:31:36.760197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.760760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e3ea49bb-dcf7-4c1c-a45f-6b15109d6797 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 404 len: 111 microversion: 2.1 time: 0.027231 Nov 21 17:31:36.765196 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 680/1366] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:31:36 2021] DELETE /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:31:36.769643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:36.770242 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: ce1cec94-c4f2-4f9e-8490-35c03810625f] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:36.775914 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.776355 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.777100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:36.777526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:36.790582 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. Nov 21 17:31:36.791183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance ce1cec94-c4f2-4f9e-8490-35c03810625f could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:31:36.791989 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-18138a18-af46-4863-9a25-500728152f1a tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f" status: 404 len: 111 microversion: 2.1 time: 0.025855 Nov 21 17:31:36.792510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 681/1367] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:36 2021] GET /compute/v2.1/servers/ce1cec94-c4f2-4f9e-8490-35c03810625f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:31:36.821311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:36.829414 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-031e69fd-47d6-488e-88fd-52ace91a8392 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081292 Nov 21 17:31:36.829977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 687/1368] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:36 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:37.846678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:37.847281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:37.852967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:37.853405 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:37.854186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:37.854614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:37.912851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:37.920502 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1a9d46e4-9d68-449a-8d0d-e84f2ecc8a0a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077971 Nov 21 17:31:37.921052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 682/1369] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:37 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:38.938189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:38.938850 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:38.944556 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:38.945000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:38.945750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:38.946178 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:39.006132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:39.013797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e96aa95d-3451-4ef7-a941-1664b1a8c2b9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080013 Nov 21 17:31:39.014499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 688/1370] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:38 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:40.030934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:40.031604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:40.037255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:40.037701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:40.038459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:40.038921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:40.101562 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:40.109765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ba1a1894-6889-4ce4-85fd-a77a5a150ab0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.083040 Nov 21 17:31:40.110327 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 683/1371] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:40 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:41.127405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:41.128015 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:41.133772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:41.134222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:41.135005 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:41.135470 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:41.193530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:41.201153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ce40e4d6-edda-4888-80d3-79ff9c93ae7f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078251 Nov 21 17:31:41.201867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 689/1372] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:41 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:42.218490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:42.219134 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:42.224883 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:42.225331 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:42.226092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:42.226528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:42.284520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:42.292116 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b3ffe86d-023d-4467-9037-2b5fb8578d4a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077520 Nov 21 17:31:42.292667 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 684/1373] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:42 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:43.095473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:31:43.096041 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:31:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:31:43.309602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:43.310157 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:43.316738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:43.317175 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:43.317929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:43.318351 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:43.383734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:43.392618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dc58d8d9-cd8c-488f-8065-14e0525112b2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.086873 Nov 21 17:31:43.393192 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 690/1374] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:43 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:44.410692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:44.411302 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:44.417063 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:44.417510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:44.418265 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:44.418725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:44.477113 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:44.484976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-eb07230e-dbb8-4e46-ac01-42bd2441417c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078038 Nov 21 17:31:44.485534 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 685/1375] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:44 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:45.501358 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:45.501933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:45.507503 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:45.507951 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:45.508707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:45.509134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:45.568421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:45.576053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-13c5413e-233a-41a2-a167-8f2350351ac0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078585 Nov 21 17:31:45.577209 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 691/1376] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:45 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:46.593614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:46.594232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:46.600025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:46.600472 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:46.601231 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:46.601672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:46.664055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:46.671759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cf6ac9b2-fc80-4493-8c12-3ff432178f88 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082139 Nov 21 17:31:46.672315 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 686/1377] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:46 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:47.689314 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:47.689903 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:47.695727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:47.696169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:47.696920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:47.697356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:47.756431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:47.764272 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8bc43fa6-dd63-449d-bcf4-7180d04f9e04 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079388 Nov 21 17:31:47.764834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 692/1378] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:47 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:48.781523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:48.782132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:48.788069 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:48.788520 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:48.789282 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:48.789718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:48.849528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:48.857124 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fd440661-497e-4cf3-ace5-6deb6f148038 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079782 Nov 21 17:31:48.858280 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 687/1379] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:48 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:49.875311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:49.875915 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:49.881696 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:49.882136 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:49.882935 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:49.883386 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:49.942906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:49.950423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8b637ee1-d220-4b72-83ad-bcc44f2bbfec tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079547 Nov 21 17:31:49.951018 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 693/1380] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:49 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:50.967879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:50.968486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:50.974200 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:50.974668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:50.975425 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:50.975854 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:51.033902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:51.041482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9329f776-d69e-4825-84b1-2956cf1e6889 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077598 Nov 21 17:31:51.042035 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 688/1381] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:50 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:52.058082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:52.058721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:52.064581 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:52.065024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:52.065769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:52.066193 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:52.124743 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:52.132197 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d86798a4-d92b-4efc-a4d1-c965b501f110 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077728 Nov 21 17:31:52.132744 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 694/1382] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:52 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:53.149388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:53.150015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:53.156157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:53.156604 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:53.157393 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:53.157825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:53.220089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:53.227745 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-81dbbd2b-9ca3-406a-a9fc-fceb2001054f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082034 Nov 21 17:31:53.228305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 689/1383] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:53 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:54.245049 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:54.245666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:54.252080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:54.252527 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:54.253281 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:54.253712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:54.311732 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:54.319294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-39cd529b-9ea2-4270-bfc6-9f4dbfecb002 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077923 Nov 21 17:31:54.319841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 695/1384] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:54 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:55.336376 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:55.337004 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:55.343841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:55.344296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:55.345060 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:55.345497 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:55.403512 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:55.412014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a7f600a4-b1b2-4e68-95bd-284fc665303e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079643 Nov 21 17:31:55.412583 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 690/1385] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:55 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:56.428857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:56.429455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:56.435253 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:56.435704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:56.436493 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:56.436925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:56.494976 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:56.502772 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-15f00e07-c2a4-4513-91d9-c5e702642f2c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077531 Nov 21 17:31:56.503324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 696/1386] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:56 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:57.519790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:57.520423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:57.526185 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:57.526648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:57.527422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:57.527857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:57.586728 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:57.594574 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f200feff-f26f-4c18-8cd3-c922b05c5e5a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078443 Nov 21 17:31:57.595199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 691/1387] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:57 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:58.611889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:58.612499 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:58.618268 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:58.618742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:58.619495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:58.619926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:58.679730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:58.687336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8df4c316-3315-49a3-bbab-ed754a39d216 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079531 Nov 21 17:31:58.687892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 697/1388] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:58 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:31:59.704570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:31:59.705120 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:31:59.710919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:59.711370 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:59.712131 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:31:59.712570 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:31:59.774438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:31:59.782263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-67525c1c-a9a1-4464-b32a-6bc7ed786eff tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081698 Nov 21 17:31:59.782918 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 692/1389] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:31:59 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:00.798993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:00.799638 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:00.805325 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:00.805773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:00.806525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:00.807006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:00.867937 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:00.880158 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0f28afea-ba03-48a5-9333-e0debcd2a995 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.084702 Nov 21 17:32:00.880867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 698/1390] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:00 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:01.898372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:01.899015 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:01.905832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:01.906281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:01.907082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:01.907518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:01.966686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:01.974385 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-6f322a49-c73a-4e3c-b2be-f033a0905804 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079920 Nov 21 17:32:01.974976 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 693/1391] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:01 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:02.992231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:02.992798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:02.999299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:02.999748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:03.000510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:03.000941 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:03.059411 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:03.067504 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2aadb1c6-351f-403e-88b5-f133835c1c92 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079012 Nov 21 17:32:03.068051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 699/1392] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:02 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:04.087802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:04.088415 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:04.095037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:04.095479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:04.096235 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:04.096666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:04.155442 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:04.163292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b2584109-0b12-4df7-8039-6b28d00eb9bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078924 Nov 21 17:32:04.163592 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 694/1393] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:04 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:05.180171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:05.180913 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:05.187285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:05.188054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:05.189413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:05.189862 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:05.253746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:05.261586 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-11d71f70-f2f0-4219-9131-30f6584df62e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.085112 Nov 21 17:32:05.262129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 700/1394] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:05 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:06.277760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:06.278379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:06.284782 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:06.285234 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:06.285997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:06.286433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:06.348870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:06.356523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4fc1f94b-f313-4103-9905-86d1428440be tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082421 Nov 21 17:32:06.357090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 695/1395] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:06 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:07.373703 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:07.374410 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:07.380124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:07.380570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:07.381332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:07.381767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:07.440682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:07.448425 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1a0b4695-339b-45ec-8ad6-5785c5889ca4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078763 Nov 21 17:32:07.448929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 701/1396] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:07 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:08.466441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:08.467324 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:08.473092 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:08.473543 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:08.474307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:08.474773 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:08.534552 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:08.542284 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-f0b4b3f2-20d1-4807-93db-1ea5ce8a510b tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080004 Nov 21 17:32:08.542875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 696/1397] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:08 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:09.559788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:09.560401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:09.566201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:09.566665 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:09.567418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:09.567846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:09.626483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:09.634016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e55b0754-7624-4953-86ab-57e65d3c6a2f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077899 Nov 21 17:32:09.634560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 702/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:09 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:10.652399 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:10.652939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:10.659499 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:10.659949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:10.660704 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:10.661138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:10.719232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:10.726952 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1e7e3ef3-779b-4bc5-8283-a12497fa099e tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078217 Nov 21 17:32:10.727516 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 697/1399] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:10 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:11.743895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:11.744501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:11.751111 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:11.751560 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:11.752319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:11.752750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:11.809788 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:11.818090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-843f7fc7-ac12-4d94-8cb2-cb5106407f67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077873 Nov 21 17:32:11.818667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 703/1400] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:11 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:12.835458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:12.836071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:12.842994 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:12.843441 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:12.844205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:12.844636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:12.906065 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:12.913643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-eb83d000-62c3-4ba3-b82a-7764895979e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081814 Nov 21 17:32:12.914212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 698/1401] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:12 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:32:13.930690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:13.931303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:13.937663 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:13.938115 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:13.938899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:13.939335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:13.996959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:14.004595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7e71d105-c235-4d21-ba48-eb3a4d1bc60a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077594 Nov 21 17:32:14.005145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 704/1402] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:13 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:15.021307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:15.021916 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:15.027802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:15.028255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:15.029013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:15.029448 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:15.087723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:15.095754 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-72f5b497-00b9-4424-81ce-7e996777affb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078354 Nov 21 17:32:15.096316 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 699/1403] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:15 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:16.112704 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:16.113317 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:16.119151 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:16.119602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:16.120361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:16.120797 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:16.179413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:16.187687 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-feef4ad5-7b44-4e7f-89b1-4efd1cf6d3b0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078694 Nov 21 17:32:16.188246 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 705/1404] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:16 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:17.204781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:17.205379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:17.211140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:17.211587 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:17.212342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:17.212772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:17.271807 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:17.280081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-fe10c4aa-8e41-4a01-af9b-1187bf4daa9f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078300 Nov 21 17:32:17.280638 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 700/1405] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:17 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:18.297773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:18.298308 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:18.304092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:18.304536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:18.305279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:18.305705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:18.367538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:18.376231 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6ad0009b-b0d6-4d0c-b592-7fbd1716260f tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082841 Nov 21 17:32:18.376794 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 706/1406] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:18 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:19.393748 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:19.394354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:19.400183 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:19.400627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:19.401379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:19.401811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:19.463347 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:19.471205 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f495ac6-3109-45e6-bd46-f90eaa0cb404 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081100 Nov 21 17:32:19.471760 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 701/1407] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:19 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:20.488571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:20.489180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:20.494948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:20.495395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:20.496152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:20.496583 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:20.561751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:20.569363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e0a5d027-18d2-46a4-83e1-1d7daf1414b1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.084491 Nov 21 17:32:20.569911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 707/1408] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:20 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:21.586827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:21.587444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:21.593642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:21.594079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:21.594851 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:21.595281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:21.653424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:21.661125 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-12fbf2b3-677a-434c-86d6-59699aabec67 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077957 Nov 21 17:32:21.661846 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 702/1409] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:21 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:22.677992 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:22.678635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:22.684405 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:22.684851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:22.685789 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:22.686249 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:22.744889 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:22.752727 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0fc7669d-af60-437a-b62a-eae24177facd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078439 Nov 21 17:32:22.753287 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 708/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:22 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:23.769944 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:23.770547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:23.776464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:23.776910 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:23.777662 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:23.778090 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:23.835848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:23.843702 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c8792863-471e-4b91-9eaa-9af845427bdb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077378 Nov 21 17:32:23.844254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 703/1411] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:23 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:24.861236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:24.861886 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:24.867931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:24.868379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:24.869138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:24.869571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:24.927910 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:24.936460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2b888cd0-a8fa-4b76-a351-e86750692de7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079609 Nov 21 17:32:24.937011 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 709/1412] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:24 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:25.953894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:25.954510 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:25.960369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:25.960808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:25.961558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:25.961984 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:26.023882 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:26.031606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-aed8b251-4934-4013-9baf-bad8ecb584e1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082187 Nov 21 17:32:26.032160 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 704/1413] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:25 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:27.048933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:27.049460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:27.055226 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:27.055661 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:27.056406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:27.056830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:27.116709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:27.124882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-cf4c45cf-88de-4a75-a53c-d161aa09bcac tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080274 Nov 21 17:32:27.125429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 710/1414] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:27 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:28.142062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:28.142724 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:28.148464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:28.148913 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:28.149677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:28.150110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:28.209061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:28.217569 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-43c17c34-207b-47df-90dd-cf97503a7033 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079696 Nov 21 17:32:28.218366 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 705/1415] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:28 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:29.234289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:29.234929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:29.240933 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:29.241374 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:29.242135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:29.242562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:29.301536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:29.309234 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d1586041-c3ba-4096-bef8-e455615563db tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078683 Nov 21 17:32:29.309784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 711/1416] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:29 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:30.325010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:30.326129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:30.331845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:30.332292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:30.333043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:30.333475 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:30.391744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:30.399576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-61ddcaab-49a3-4698-b10d-d80c087ab08a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078207 Nov 21 17:32:30.400449 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 706/1417] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:30 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:31.416839 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:31.417456 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:31.424063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:31.424508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:31.425269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:31.425705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:31.484095 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:31.491978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-43e1fd69-e719-4e77-a71c-908200e0f77a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078737 Nov 21 17:32:31.492524 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 712/1418] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:31 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:32.508608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:32.509252 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:32.514838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:32.515291 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:32.516055 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:32.516493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:32.579894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:32.587631 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-790d1130-d3c4-4d7c-ad7e-9297527360c4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082620 Nov 21 17:32:32.588188 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 707/1419] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:32 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:33.604572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:33.605187 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:33.611201 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:33.611653 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:33.612413 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:33.612847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:33.672546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:33.680074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d45921a2-df08-4a30-af63-9316f3bf6cca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079178 Nov 21 17:32:33.680617 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 713/1420] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:33 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:34.696728 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:34.697332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:34.703070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:34.703506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:34.704255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:34.704679 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:34.763505 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:34.770973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-879a04d3-7a61-4a7b-9dd3-ee83f3e6d4ca tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077808 Nov 21 17:32:34.771765 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 708/1421] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:34 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:35.787082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:35.787691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:35.793398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:35.793841 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:35.794700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:35.795153 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:35.853352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:35.860982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d0563936-8b17-421c-966b-be0eaa39882a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077494 Nov 21 17:32:35.861715 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 714/1422] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:35 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:36.877811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:36.878420 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:36.884197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:36.884647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:36.885400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:36.885834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:36.944861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:36.953020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5f6b8d53-7e8d-4489-be70-8457d0f6a619 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078830 Nov 21 17:32:36.953580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 709/1423] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:36 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:37.199035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:32:37.199575 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:32:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:32:37.970372 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:37.970990 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:37.976906 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:37.977361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:37.978125 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:37.978558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:38.037547 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:38.045631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9433baaf-10f2-4961-99df-c850266436a9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079192 Nov 21 17:32:38.046189 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 715/1424] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:37 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:39.063256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:39.063803 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:39.069474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:39.069921 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:39.070688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:39.071115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:39.133666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:39.141278 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-3f302682-fa27-41e2-8ef1-d050602e1bf4 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082403 Nov 21 17:32:39.141826 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 710/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:39 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:40.159028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:40.159627 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:40.165603 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:40.166052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:40.166845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:40.167316 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:40.225501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:40.234104 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-44baa0ff-6589-4bf7-a040-b4179c307cc9 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078731 Nov 21 17:32:40.234679 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 716/1426] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:40 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:41.251133 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:41.251747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:41.257523 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:41.257970 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:41.258767 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:41.259203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:41.318352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:41.326598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ea2315c2-c9ba-4ce4-b726-d2e2889c4509 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079226 Nov 21 17:32:41.327177 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 711/1427] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:41 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:42.343726 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:42.344346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:42.350244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:42.350721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:42.351483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:42.351918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:42.412847 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:42.421562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c45a37a0-08c4-4692-9495-c964334add6a tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081888 Nov 21 17:32:42.422381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 717/1428] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:42 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:43.438827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:43.439462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:43.445247 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:43.445696 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:43.446455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:43.446920 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:43.504857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:43.512417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4a45bbb8-6347-4cd6-944c-60d4b2197662 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077798 Nov 21 17:32:43.513603 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 712/1429] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:43 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:44.529776 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:44.530387 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:44.536156 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:44.536601 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:44.537359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:44.537790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:44.596352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:44.604031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f62f1108-39b2-4bce-96b5-12c36fd60565 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078014 Nov 21 17:32:44.604587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 718/1430] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:44 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:45.621598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:45.622744 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:45.628680 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:45.629126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:45.629893 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:45.630332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:45.693917 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:45.702934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1df60f2f-1a75-4fa2-bf83-a6770c87136d tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.085001 Nov 21 17:32:45.703507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 713/1431] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:45 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:46.719445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:46.720054 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:46.725816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:46.726261 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:46.727052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:46.727484 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:46.786006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:46.793654 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b7bf23f7-f0f5-4b38-9148-8b1e77a171bb tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078205 Nov 21 17:32:46.794778 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 719/1432] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:46 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:47.811082 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:47.811694 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:47.817325 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:47.817767 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:47.818518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:47.818973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:47.882416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:47.890195 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1c02fd4d-5bce-4149-95db-128bd7c2de30 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.082845 Nov 21 17:32:47.890784 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 714/1433] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:47 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:48.907998 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:48.908606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:48.914498 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:48.914975 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:48.915730 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:48.916164 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:48.974780 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:48.982548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b84d693d-91ad-458f-bbb1-f99f7bc99f86 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079038 Nov 21 17:32:48.983132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 720/1434] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:48 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:50.000341 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:50.000887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:50.006642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:50.007178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:50.008227 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:50.008660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:50.066672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:50.074215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b38ae2e0-e8eb-4770-8613-06e679c39058 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078346 Nov 21 17:32:50.074794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 715/1435] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:49 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:51.092553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:51.093163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:51.098940 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:51.099468 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:51.100236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:51.100668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:51.158045 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:51.165691 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3e01efda-1761-4f72-86a9-d371f9f034da tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077646 Nov 21 17:32:51.166250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 721/1436] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:51 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:52.184087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:52.184695 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:52.191173 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:52.191610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:52.192353 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:52.192778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:52.254857 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:52.262338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-efc1254d-de1a-4154-adc9-f7784fd73733 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081960 Nov 21 17:32:52.263110 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 716/1437] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:52 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:53.279365 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:53.279968 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:53.285739 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:53.286190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:53.286983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:53.287418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:53.345333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:53.353200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e45295de-d03f-46a1-88a5-c459638416ba tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077503 Nov 21 17:32:53.353769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 722/1438] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:53 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:54.372801 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:54.373571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:54.379718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:54.380189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:54.381267 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:54.382014 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:54.454945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:54.462647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e1896d0b-93df-48f6-adf7-0ccfb2db73e5 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.094299 Nov 21 17:32:54.463240 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 717/1439] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:54 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:55.482070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:55.482705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:55.488523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:55.488972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:55.489729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:55.490188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:55.552332 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:55.561674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-68555599-7d0a-4540-87b9-aa1272214086 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.083482 Nov 21 17:32:55.562232 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 723/1440] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:55 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:56.579076 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:56.579681 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:56.585297 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:56.585738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:56.586486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:56.586953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:56.651892 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:56.660217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-33f59da0-bbd6-427a-b0af-6abca4dd2f8c tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.085656 Nov 21 17:32:56.660778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 718/1441] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:56 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:57.676897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:57.677503 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:57.683211 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:57.683657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:57.684412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:57.685333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:57.744170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:57.752311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-74e943d7-de4f-4869-8d77-111322ca0507 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079050 Nov 21 17:32:57.752861 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 724/1442] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:57 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:58.769007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:58.769615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:58.775364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:58.775810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:58.776568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:58.776999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:58.838539 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:58.846545 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4d6b0af8-d07f-48c9-919a-bb7a044e6006 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081188 Nov 21 17:32:58.847134 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 719/1443] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:58 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:32:59.863369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:32:59.863984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:32:59.869662 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:59.870109 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:59.870914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:32:59.871346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:32:59.930709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:32:59.939114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8d60aadf-938a-4673-9c5d-4ae8d08539bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079519 Nov 21 17:32:59.939675 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 725/1444] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:32:59 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:00.956336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:00.956934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:00.963254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:00.963735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:00.964518 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:00.964948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:01.023126 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:01.031309 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bc4f2106-c918-4fff-ad5a-631615d47d05 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078580 Nov 21 17:33:01.031873 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 720/1445] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:00 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:02.049584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:02.050219 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:02.055997 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:02.056437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:02.057182 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:02.057606 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:02.116978 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:02.124961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3ccaa341-4757-4957-a28b-79156c1069ed tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079113 Nov 21 17:33:02.125525 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 726/1446] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:02 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:03.141545 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:03.142145 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:03.147877 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:03.148320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:03.149067 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:03.149495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:03.207012 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:03.214379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-81e7ecd9-81fb-4b75-aab6-4b4ce54abc71 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.076518 Nov 21 17:33:03.214967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 721/1447] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:03 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:04.231987 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:04.232602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:04.238479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:04.238966 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:04.239738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:04.240176 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:04.300098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:04.308338 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d455f179-dd8c-41fb-a512-c4b5655ce2e0 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080264 Nov 21 17:33:04.308901 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 727/1448] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:04 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:05.326526 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:05.327129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:05.332814 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:05.333272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:05.334036 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:05.334470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:05.398306 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:05.406650 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0923cab7-e5bd-4a2b-ad77-1fb2788994e2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.084455 Nov 21 17:33:05.407214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 722/1449] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:05 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:33:06.423917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:06.424536 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:06.430236 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:06.430721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:06.431486 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:06.431920 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:06.490479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:06.498491 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-84bc1dc9-0027-430a-81af-950f7272f1bf tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078203 Nov 21 17:33:06.499063 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 728/1450] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:06 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:07.516017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:07.516643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:07.523380 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:07.523827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:07.524568 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:07.524992 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:07.582954 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:07.590354 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-69cb1ee5-1d77-48f0-a026-b8a10dc77b63 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078761 Nov 21 17:33:07.591379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 723/1451] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:07 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:08.175381 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:08.176098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:08.181686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.182124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.182899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.183591 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.197680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. Nov 21 17:33:08.198252 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:33:08.199092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-26c0f446-e4c4-4385-a368-3d0bc3264821 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 404 len: 111 microversion: 2.1 time: 0.027339 Nov 21 17:33:08.199628 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 729/1452] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:33:08 2021] DELETE /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:33:08.207345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:08.207993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: 02bcb091-a1a4-40bc-b707-333917982e30] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:08.213802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.214254 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.215052 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.215488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.229507 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. Nov 21 17:33:08.230102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance 02bcb091-a1a4-40bc-b707-333917982e30 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:33:08.230949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8c963215-c415-4b45-a236-00bf72ecd95e tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30" status: 404 len: 111 microversion: 2.1 time: 0.027228 Nov 21 17:33:08.232427 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 724/1453] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:08 2021] GET /compute/v2.1/servers/02bcb091-a1a4-40bc-b707-333917982e30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:33:08.608144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:08.608759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:08.614568 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.615042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.615803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:08.616237 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:08.676348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:08.684029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-db547bea-a2cd-44b9-bf55-36c31e180a66 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.080172 Nov 21 17:33:08.685294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 730/1454] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:08 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:09.701691 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:09.702296 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:09.708219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:09.708677 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:09.709439 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:09.709864 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:09.768487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:09.776042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ef52a259-dff8-4175-8afc-592d4a443d19 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078205 Nov 21 17:33:09.776602 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 725/1455] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:09 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:10.793036 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:10.793635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:10.800029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:10.800472 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:10.801218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:10.801642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:10.863548 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:10.871144 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d753f9d0-f6e4-4cf0-99f5-4ec26503bdf2 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081776 Nov 21 17:33:10.871702 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 731/1456] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:10 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:11.889611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:11.890228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:11.896105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:11.896555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:11.897318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:11.897750 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:11.959108 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:11.967005 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2b0b4a0c-3717-44a6-9ad9-526805852cd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.081779 Nov 21 17:33:11.967560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 726/1457] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:11 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:12.983618 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:12.984212 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:12.990038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:12.990421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:12.991202 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:12.991632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:13.049588 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:13.057186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-449315d5-f24a-4309-9a13-0238fce303dd tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.077780 Nov 21 17:33:13.057738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 732/1458] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:12 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:14.074816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:14.075553 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:14.082086 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:14.082524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:14.083294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:14.083718 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:14.142500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:14.150191 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-01ddfc6c-078c-4ff9-8a09-81d64a13d6fa tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079059 Nov 21 17:33:14.150764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 727/1459] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:14 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:15.167080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:15.167713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:15.174078 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:15.174517 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:15.175324 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:15.175746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:15.234174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:15.241748 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-391fdb90-4d35-4e7c-b4ad-f2c87e77a3a7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.078301 Nov 21 17:33:15.242290 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 733/1460] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:15 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:16.259608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:16.260237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:16.268081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:16.268860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:16.269626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:16.270053 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:16.328064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:16.335926 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8c0d507c-730c-44fd-b5c5-d4c597b68455 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.079970 Nov 21 17:33:16.336487 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 728/1461] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:16 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:17.353487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:17.354118 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:17.360028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:17.360473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:17.361224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:17.361664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:17.419068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:17.426732 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dd44bc89-d1a0-4b13-8493-f328f00c87b8 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1350 microversion: 2.1 time: 0.076908 Nov 21 17:33:17.427282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 734/1462] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:17 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:18.443153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:18.443796 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:18.449597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:18.450046 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:18.451024 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:18.451461 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:18.480717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:18.481162 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:18.481607 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.objects.instance [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lazy-loading 'fault' on Instance uuid d04b8ac9-3c74-4720-9ee3-03113212ad92 {{(pid=115854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:33:18.524149 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '200cbc1416db4298a26d49d43be6b2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ddce0d66654838a91b9d32226dcaf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:33:18.532597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-72be76fe-1216-4ed4-af62-6a14f60c5bd1 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 200 len: 1444 microversion: 2.1 time: 0.093103 Nov 21 17:33:18.533335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 729/1463] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:18 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:33:19.550399 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:33:19.550983 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] [instance: d04b8ac9-3c74-4720-9ee3-03113212ad92] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:33:19.556731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:19.557174 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:19.557928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:33:19.558354 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:33:19.571689 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] HTTP exception thrown: Instance d04b8ac9-3c74-4720-9ee3-03113212ad92 could not be found. Nov 21 17:33:19.572263 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] Returning 404 to user: Instance d04b8ac9-3c74-4720-9ee3-03113212ad92 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:33:19.573053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2767d57e-c53c-4b76-80d3-62ef3ac51ce7 tempest-VolumesSnapshotTestJSON-1739513863 tempest-VolumesSnapshotTestJSON-1739513863-project] 10.222.0.52 "GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92" status: 404 len: 111 microversion: 2.1 time: 0.026479 Nov 21 17:33:19.573555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 735/1464] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:33:19 2021] GET /compute/v2.1/servers/d04b8ac9-3c74-4720-9ee3-03113212ad92 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:34:13.309250 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:34:13.309825 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:34:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:34:34.385089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:34:34.385660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:34:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:35:03.113113 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:35:03.113657 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:35:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:35:57.216213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:35:57.216858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:35:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:35:57.280798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:35:57.281270 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:35:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:36:25.297984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:36:25.297984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:36:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:37:33.326911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:37:33.327462 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:37:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:37:36.455678 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:37:36.456292 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:37:36.460013 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:37:36.464410 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:37:36.464856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:37:36.465609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:37:36.466042 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:37:36.478720 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. Nov 21 17:37:36.479303 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:37:36.480104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-35d11056-8c39-4eb2-add5-598d7ddfca53 tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 404 len: 111 microversion: 2.1 time: 0.028609 Nov 21 17:37:36.480608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 730/1465] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:37:36 2021] DELETE /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:37:36.486298 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:37:36.490177 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:37:36.490849 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] [instance: 9a72ec97-159e-42a7-b4d8-b10ea675fb22] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:37:36.497276 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:37:36.497724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:37:36.498483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:37:36.498947 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:37:36.512038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] HTTP exception thrown: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. Nov 21 17:37:36.512619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] Returning 404 to user: Instance 9a72ec97-159e-42a7-b4d8-b10ea675fb22 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:37:36.513423 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-be949191-6deb-4c0b-a17d-fbb5ead2da1d tempest-AttachVolumeShelveTestJSON-289057615 tempest-AttachVolumeShelveTestJSON-289057615-project] 10.222.0.52 "GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22" status: 404 len: 111 microversion: 2.1 time: 0.028925 Nov 21 17:37:36.513927 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 736/1466] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:37:36 2021] GET /compute/v2.1/servers/9a72ec97-159e-42a7-b4d8-b10ea675fb22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:37:54.402483 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:37:54.403061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:37:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:38:23.130845 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:38:23.131369 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:38:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:39:08.798000 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:39:08.798546 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:39:08.806967 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:39:08.807407 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:39:08.808159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:39:08.808614 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:39:08.811891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 47462. Nov 21 17:39:08.823345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. Nov 21 17:39:08.823924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:39:08.824729 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-92b8a399-9d91-4819-ae2b-c9b6319b2ab5 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 404 len: 111 microversion: 2.1 time: 0.041735 Nov 21 17:39:08.825238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 731/1467] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:39:08 2021] DELETE /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 21 17:39:08.843553 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:39:08.844160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] [instance: a2b914fc-c9f9-436e-9895-ca4fd17481c4] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:39:08.850737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:39:08.851181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:39:08.852099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:39:08.852542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:39:08.858027 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 47468. Nov 21 17:39:08.866667 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] HTTP exception thrown: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. Nov 21 17:39:08.867813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] Returning 404 to user: Instance a2b914fc-c9f9-436e-9895-ca4fd17481c4 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:39:08.868629 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-58802a3d-a798-4d85-8c2e-10470fe33104 tempest-AttachVolumeTestJSON-145824682 tempest-AttachVolumeTestJSON-145824682-project] 10.222.0.52 "GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4" status: 404 len: 111 microversion: 2.1 time: 0.039405 Nov 21 17:39:08.869145 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 737/1468] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:39:08 2021] GET /compute/v2.1/servers/a2b914fc-c9f9-436e-9895-ca4fd17481c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:39:17.233142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:39:17.233769 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:39:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:39:17.296971 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:39:17.297480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:39:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:39:45.315363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:39:45.315929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:39:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:40:53.344810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:40:53.345686 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:40:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:41:14.419946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:41:14.420524 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:41:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:41:43.147119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:41:43.147654 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:41:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:42:37.251313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:42:37.251955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:42:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:42:37.314307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:42:37.314811 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:42:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:43:05.332802 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:43:05.333395 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:43:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:44:13.362945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:44:13.363492 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:44:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:44:34.436333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:44:34.436973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:44:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:45:03.164282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:45:03.164892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:45:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:45:57.267634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:45:57.268285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:45:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:45:57.330201 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:45:57.330752 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:45:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:46:25.349884 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:46:25.350412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:46:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:47:33.379576 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:47:33.380144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:47:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:47:54.454276 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:47:54.454998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:47:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:48:23.180883 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:48:23.181477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:48:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:49:17.287088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:49:17.287767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:49:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:49:17.347953 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:49:17.348463 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:49:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:49:45.368508 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:49:45.369068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:49:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:50:53.396835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:50:53.398228 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:50:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:51:08.788271 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:51:08.793730 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'create', calling method: .version_select at 0x7f1fc266e4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-499398185"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:08.811424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:51:08.815130 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for user 97099c133d0144ad975f1caa7ccea71a and project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:51:09.226590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:51:09.230186 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for user 97099c133d0144ad975f1caa7ccea71a and project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:51:09.242993 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b851529d-771f-48b0-8373-4a90933b3df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.456738 Nov 21 17:51:09.243771 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 732/1469] 10.222.0.52 () {60 vars in 1157 bytes} [Sun Nov 21 17:51:08 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:09.336048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:51:09.339683 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-623800812", "imageRef": "c9acd564-e61a-49ea-b99c-3df14955be8e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-499398185", "networks": [{"uuid": "b384c66a-653f-4ddc-916a-6159a35b4118"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:09.535068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] validate_networks() for [('b384c66a-653f-4ddc-916a-6159a35b4118', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:51:10.033259 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:51:10.033681 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:51:10.034152 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:51:10.034558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:51:10.035048 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:51:10.043614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:10.044056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:10.044851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:10.045280 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:10.063816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:51:10.067808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Getting quotas for user 97099c133d0144ad975f1caa7ccea71a and project 0e7400dbf3124e3189245696b5d6bfeb. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:51:10.078346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:51:10.080570 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9acd564-e61a-49ea-b99c-3df14955be8e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:51:10.127168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-0b559068-4c7e-4027-ae65-ea1beef81fe2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792969 Nov 21 17:51:10.127807 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 738/1470] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:51:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:51:10.150215 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-81bb7249-37bb-4f59-a18b-806a9916de26 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:10.150870 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-81bb7249-37bb-4f59-a18b-806a9916de26 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:10.158343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52704. Nov 21 17:51:10.260268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-81bb7249-37bb-4f59-a18b-806a9916de26 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:10.266875 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-81bb7249-37bb-4f59-a18b-806a9916de26 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1257 microversion: 2.1 time: 0.132770 Nov 21 17:51:10.267503 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 733/1471] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:10 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1257 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:11.294808 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:11.295424 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:11.302971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:11.303500 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:11.304292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:11.304717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:11.320056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52728. Nov 21 17:51:11.363028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:11.370747 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-65359cff-7756-4fc0-8b5f-5c8974dcff9f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1261 microversion: 2.1 time: 0.089843 Nov 21 17:51:11.371311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 739/1472] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:11 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:12.388062 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:12.388674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:12.394537 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:12.395017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:12.396017 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:12.396488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:12.453547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:12.460786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8c5d7bb8-0930-48b8-8746-c6b78a4fc1cc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1253 microversion: 2.1 time: 0.076388 Nov 21 17:51:12.461342 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 734/1473] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:12 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1253 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:13.478171 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:13.478815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:13.484562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:13.485014 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:13.485773 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:13.486208 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:13.544557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:13.551542 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-782e8051-220d-4973-9a3e-e899c03c0df1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1309 microversion: 2.1 time: 0.077639 Nov 21 17:51:13.552098 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 740/1474] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:13 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1309 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:51:14.472758 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:51:14.474256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:51:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:51:14.568739 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:14.569349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:14.575352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:14.576010 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:14.576780 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:14.577203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:14.794272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:14.810919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-069cad7f-8af1-4e86-86a7-ad16b5636c2f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.246369 Nov 21 17:51:14.821813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 735/1475] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:14 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:15.828462 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:15.829070 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:15.835555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:15.836092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:15.836936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:15.837376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:15.985678 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:15.994593 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6248e864-924e-4c6a-a46d-a6b146fef6c1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.169615 Nov 21 17:51:15.995149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 741/1476] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:15 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:17.011927 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:17.012533 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:17.018362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:17.018852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:17.019619 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:17.020051 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:17.162504 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:17.171665 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4f3150d6-dfd6-4284-bb6c-deb47eae9fbd tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.163377 Nov 21 17:51:17.172289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 736/1477] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:17 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:18.189114 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:18.189723 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:18.195620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:18.196073 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:18.196834 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:18.197268 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:18.332282 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:18.340248 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-36717bff-1295-4edb-b87e-79604ff2b6ff tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.154801 Nov 21 17:51:18.340961 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 742/1478] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:18 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:19.358047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:19.358698 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:19.365212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:19.365652 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:19.366414 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:19.366934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:19.485664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:19.493633 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8996386a-2cbe-4455-b05f-02ee9a7262a9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.139334 Nov 21 17:51:19.494199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 737/1479] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:19 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:20.512188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:20.512984 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:20.520724 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:20.521376 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:20.522343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:20.522815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:20.651737 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:20.659576 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-584c1fc3-a8a1-412e-a6f4-e673b2445249 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.152028 Nov 21 17:51:20.660326 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 743/1480] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:20 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:21.677774 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:21.678451 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:21.684705 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:21.685153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:21.685911 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:21.686344 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:21.845312 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:21.853673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-695f7480-731a-4a12-9b0f-bdc6f4b26f65 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.180147 Nov 21 17:51:21.854597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 738/1481] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:21 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:22.871530 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:22.872167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:22.886042 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:22.886767 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:22.887731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:22.888163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:23.073420 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:23.086311 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-312a84dd-0b3d-4b56-9f0c-4bfba6e74b78 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.218189 Nov 21 17:51:23.087562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 744/1482] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:22 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:24.104371 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:24.104942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:24.110593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:24.111066 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:24.111832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:24.112253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:24.311049 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:24.341150 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-bf3cc198-7907-4a85-a3d2-dd6b6958faed tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.240906 Nov 21 17:51:24.362860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 739/1483] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:24 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:25.374460 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:25.375297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:25.382377 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:25.382918 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:25.383729 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:25.384161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:25.594053 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:25.603561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-baad0eba-b10f-44e0-95c9-7c03021cc98a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.232744 Nov 21 17:51:25.604132 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 745/1484] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:25 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:26.313532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-0c14b562-c5ac-44f3-a4d4-6e40cb8cac93 req-5f9e334f-91de-4578-bec4-3cb986a787b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:26.315759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:51:26.315759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:51:26.323970 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-0c14b562-c5ac-44f3-a4d4-6e40cb8cac93 req-5f9e334f-91de-4578-bec4-3cb986a787b5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:26.324422 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-0c14b562-c5ac-44f3-a4d4-6e40cb8cac93 req-5f9e334f-91de-4578-bec4-3cb986a787b5 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:26.336795 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-0c14b562-c5ac-44f3-a4d4-6e40cb8cac93 req-5f9e334f-91de-4578-bec4-3cb986a787b5 service nova] Creating event network-changed:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:51:26.342558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-0c14b562-c5ac-44f3-a4d4-6e40cb8cac93 req-5f9e334f-91de-4578-bec4-3cb986a787b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183645 Nov 21 17:51:26.343203 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 740/1485] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:51:26.628312 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:26.629037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:26.635820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:26.639390 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:26.640273 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:26.640899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:26.828360 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:26.836300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7f47bb2f-39d9-40dc-8e67-abd2f242813a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.219539 Nov 21 17:51:26.836960 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 746/1486] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:26 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:27.855404 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:27.856216 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:27.862143 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:27.862584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:27.863364 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:27.863807 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:27.984965 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:27.992213 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4964c2e2-8781-45ef-8a40-c7e68cfd6f58 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.140912 Nov 21 17:51:27.992861 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 741/1487] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:27 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:29.009225 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:29.009825 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:29.015580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:29.016016 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:29.016761 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:29.017186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:29.132814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:29.139936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-7feec93e-6a81-42a6-8100-4b4717bd18c5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.134515 Nov 21 17:51:29.140490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 747/1488] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:29 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:30.157073 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:30.157706 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:30.164011 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:30.164456 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:30.165211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:30.165642 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:30.284948 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:30.292137 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7524a929-1929-4bf1-b03d-305eaf5895b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.139008 Nov 21 17:51:30.292693 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 742/1489] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:30 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:31.308911 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:31.309442 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:31.315180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:31.315633 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:31.316389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:31.316852 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:31.432300 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:31.439440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a0e0c275-9234-46bb-9d56-1382f92c9cd0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.134273 Nov 21 17:51:31.439995 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 748/1490] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:31 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:32.457006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:32.457643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:32.463764 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:32.464211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:32.464963 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:32.465396 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:32.584655 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:32.592059 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b580a969-821d-45f6-8ca3-54cdb6a2e45f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.138716 Nov 21 17:51:32.592627 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 743/1491] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:32 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:32.869885 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-bb87be23-2857-4884-bebe-3fd942b0018f req-50a7ec32-b054-4f14-aec3-5f7538056650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "name": "network-vif-plugged", "status": "completed", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:32.871640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:51:32.871640 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:51:32.879163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-bb87be23-2857-4884-bebe-3fd942b0018f req-50a7ec32-b054-4f14-aec3-5f7538056650 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:32.879605 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-bb87be23-2857-4884-bebe-3fd942b0018f req-50a7ec32-b054-4f14-aec3-5f7538056650 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:32.891101 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-bb87be23-2857-4884-bebe-3fd942b0018f req-50a7ec32-b054-4f14-aec3-5f7538056650 service nova] Creating event network-vif-plugged:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:51:32.897445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-bb87be23-2857-4884-bebe-3fd942b0018f req-50a7ec32-b054-4f14-aec3-5f7538056650 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208654 Nov 21 17:51:32.898037 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 749/1492] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:51:33.609859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:33.610468 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:33.616156 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:33.616600 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:33.617359 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:33.617790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:33.737634 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:33.746555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8a9444b3-5915-4029-b29d-39b3f8d0c16f tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1357 microversion: 2.1 time: 0.140416 Nov 21 17:51:33.747175 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 744/1493] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:33 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:34.763598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:34.764331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:34.770549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:34.771188 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:34.772291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:34.772803 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.120378 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:35.128031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c18d6059-4e48-43bf-be7a-274ee8920093 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1546 microversion: 2.1 time: 0.368562 Nov 21 17:51:35.128632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 750/1494] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:34 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:51:35.149845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:35.151047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:35.162915 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.163858 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.165281 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.166064 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.319585 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:35.329450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-2ed81d21-3dc8-432d-8674-cca5dc49ec13 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1546 microversion: 2.1 time: 0.187723 Nov 21 17:51:35.333094 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 745/1495] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:35 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:35.346412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:35.351138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:51:35.351138 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:51:35.352137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:35.352878 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Searching by: {'deleted': False, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb'} {{(pid=115853) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 21 17:51:35.361817 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.362258 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.363090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.363519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.454515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.multi_cell_list [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115853) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 21 17:51:35.551315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d409b23b-7742-4f83-8274-7a2319c209b9 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208562 Nov 21 17:51:35.552017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 751/1496] 10.222.0.52 () {58 vars in 1124 bytes} [Sun Nov 21 17:51:35 2021] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:51:35.561812 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:35.562578 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:35.568515 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.568962 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.569791 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:35.570317 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:35.752430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:35.762138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-7726bce9-8e02-45af-9f3c-093fa9b9e715 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1546 microversion: 2.1 time: 0.203794 Nov 21 17:51:35.762733 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 746/1497] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:35 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:37.355752 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56db4327-44e9-41f9-b216-6b6af34405b8"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:37.359685 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:37.366557 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:37.367217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:37.368331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:37.368867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:37.622023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9869eb6b-ccf4-479a-a761-10698d8b4388 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270341 Nov 21 17:51:37.622904 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 752/1498] 10.222.0.52 () {60 vars in 1322 bytes} [Sun Nov 21 17:51:37 2021] POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:51:43.197592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:51:43.198511 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:51:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:51:44.679395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Action: 'create', calling method: .version_select at 0x7f1fc262be50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-343158482"}} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:44.699542 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for project 7d0e24068212426f85e492e396995ed9. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:51:44.703500 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for user 1e8f63a305ae429c8ab6fc62b920bd32 and project 7d0e24068212426f85e492e396995ed9. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:51:44.864672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for project 7d0e24068212426f85e492e396995ed9. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:51:44.868715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.quota [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for user 1e8f63a305ae429c8ab6fc62b920bd32 and project 7d0e24068212426f85e492e396995ed9. Resources: {'key_pairs'} {{(pid=115854) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:51:44.883089 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1ae8419b-5416-4811-96dd-51eb743d1a57 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.417825 Nov 21 17:51:44.883687 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 747/1499] 10.222.0.52 () {60 vars in 1157 bytes} [Sun Nov 21 17:51:44 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:45.299302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:45.300086 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:45.311071 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:45.311528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:45.312302 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:45.312738 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:45.627631 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:45.639512 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-1b1fe9d3-3205-4da8-93ce-909380badf8b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1592 microversion: 2.1 time: 0.344618 Nov 21 17:51:45.640159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 753/1500] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:45 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1592 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:51:47.925071 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-d922f278-7c0e-457b-821d-ac1bac6345e5 req-5dea0633-3430-4715-87c6-e3e801ade3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:47.926644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:51:47.926644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:51:47.940981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d922f278-7c0e-457b-821d-ac1bac6345e5 req-5dea0633-3430-4715-87c6-e3e801ade3ce service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:47.941749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d922f278-7c0e-457b-821d-ac1bac6345e5 req-5dea0633-3430-4715-87c6-e3e801ade3ce service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:47.962769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-d922f278-7c0e-457b-821d-ac1bac6345e5 req-5dea0633-3430-4715-87c6-e3e801ade3ce service nova] Creating event network-changed:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:51:47.969350 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-d922f278-7c0e-457b-821d-ac1bac6345e5 req-5dea0633-3430-4715-87c6-e3e801ade3ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128168 Nov 21 17:51:47.971605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 748/1501] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:51:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:51:49.201697 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1727116551"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:49.202830 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:49.209562 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:49.210190 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:49.210979 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:49.211567 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:49.350688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.network.security_group_api [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Adding security group 0ded680c-893c-4046-8d81-eda6bc332702 to port 215b8d08-a8fd-4000-bb83-5aaadda19562 Nov 21 17:51:49.717166 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-28a9acbc-49d9-4808-acf7-8babc7c2e9b0 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action" status: 202 len: 0 microversion: 2.1 time: 0.519241 Nov 21 17:51:49.718589 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 754/1502] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:51:49 2021] POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:51:49.727889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:51:49.729985 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:51:49.737969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-8962b72f-13b9-4fda-9ed3-ecbaf58e1872 req-c7a9cbd6-efc8-4bf1-8338-c440d16f5fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:51:49.741088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:51:49.741088 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:51:49.744259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:49.745372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:49.747140 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:49.747924 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:49.762435 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-8962b72f-13b9-4fda-9ed3-ecbaf58e1872 req-c7a9cbd6-efc8-4bf1-8338-c440d16f5fbd service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:51:49.762925 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-8962b72f-13b9-4fda-9ed3-ecbaf58e1872 req-c7a9cbd6-efc8-4bf1-8338-c440d16f5fbd service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:51:49.783168 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-8962b72f-13b9-4fda-9ed3-ecbaf58e1872 req-c7a9cbd6-efc8-4bf1-8338-c440d16f5fbd service nova] Creating event network-changed:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:51:49.795756 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-8962b72f-13b9-4fda-9ed3-ecbaf58e1872 req-c7a9cbd6-efc8-4bf1-8338-c440d16f5fbd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061670 Nov 21 17:51:49.796455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 755/1503] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:51:50.019129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:51:50.045400 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-eae1a254-8978-4f32-894e-f6adf9eb1a90 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1758 microversion: 2.1 time: 0.322274 Nov 21 17:51:50.060860 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 749/1504] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:51:49 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1758 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:03.319161 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1534732767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343158482", "security_groups": [{"name": "tempest-secgroup-smoke-2010068226"}], "block_device_mapping_v2": [{"uuid": "d4339fcc-d971-471d-b705-6178c4f3d49e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1574b58-abb3-4ac5-834b-391c5735d81c"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:52:03.419285 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] validate_networks() for [('b1574b58-abb3-4ac5-834b-391c5735d81c', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:52:03.777677 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:52:03.778106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:52:03.778580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:52:03.779029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:52:03.779439 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:52:03.788464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:03.788914 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:03.789712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:03.790146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:03.806674 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:52:03.810501 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for user 1e8f63a305ae429c8ab6fc62b920bd32 and project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:52:03.869846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:52:03.872087 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4339fcc-d971-471d-b705-6178c4f3d49e',volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:52:03.990135 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b91a2809-bec8-4169-8964-c48fb314091a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675442 Nov 21 17:52:03.991359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 756/1505] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:52:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:52:04.001081 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-57a41002-7538-404c-ac1b-ce2fb0739691 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:04.001868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-57a41002-7538-404c-ac1b-ce2fb0739691 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:04.054068 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-57a41002-7538-404c-ac1b-ce2fb0739691 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:04.060675 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-57a41002-7538-404c-ac1b-ce2fb0739691 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1094 microversion: 2.1 time: 0.063286 Nov 21 17:52:04.061584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 750/1506] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:03 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:05.078163 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:05.078798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:05.086528 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:05.087092 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:05.087867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:05.088299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:05.150181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:05.157692 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8d67d076-be84-4ff9-88c1-1e75dcb09fc0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1210 microversion: 2.1 time: 0.083290 Nov 21 17:52:05.168023 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 757/1507] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:05 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:06.175894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:06.176647 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:06.184138 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:06.184593 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:06.185377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:06.185966 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:06.327540 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-958c3a3e-446e-4f0c-9f67-90708dad5b1f req-9b14531b-8591-40c8-8e10-183ee76e32d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8f0a13-6c04-4d4e-bf79-c03685aee59e", "tag": "01665633-4e1f-4fd5-ab59-36fa4857cabe"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:52:06.329393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:52:06.329393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:52:06.338709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-958c3a3e-446e-4f0c-9f67-90708dad5b1f req-9b14531b-8591-40c8-8e10-183ee76e32d3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:06.339494 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-958c3a3e-446e-4f0c-9f67-90708dad5b1f req-9b14531b-8591-40c8-8e10-183ee76e32d3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:06.353319 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-958c3a3e-446e-4f0c-9f67-90708dad5b1f req-9b14531b-8591-40c8-8e10-183ee76e32d3 service nova] Creating event network-changed:01665633-4e1f-4fd5-ab59-36fa4857cabe for instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e on hv-cinder-81869 Nov 21 17:52:06.358349 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-958c3a3e-446e-4f0c-9f67-90708dad5b1f req-9b14531b-8591-40c8-8e10-183ee76e32d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040987 Nov 21 17:52:06.359537 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 758/1508] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:52:06.414417 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:06.423490 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4cca8523-dcfd-41e5-8760-b4c0662f5945 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.251891 Nov 21 17:52:06.424217 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 751/1509] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:06 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:07.441624 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:07.442245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:07.448352 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:07.448806 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:07.449571 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:07.450012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:07.567758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:07.575291 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f3f8eefd-6a2c-474b-b2ed-10c4ba39af72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.137701 Nov 21 17:52:07.575859 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 759/1510] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:07 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:08.592384 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:08.593159 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:08.600454 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:08.601031 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:08.601907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:08.602389 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:08.728225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:08.735433 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4cab705c-684e-479d-9b4a-beff9193e9cf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.146904 Nov 21 17:52:08.736002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 752/1511] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:08 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:09.752690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:09.753336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:09.759970 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:09.760418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:09.761181 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:09.761639 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:09.882454 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:09.889643 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9090de9d-41ba-483d-b362-289bf4039a62 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.140736 Nov 21 17:52:09.890200 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 760/1512] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:09 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:10.906412 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:10.906973 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:10.912909 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:10.913351 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:10.914104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:10.914544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:11.029528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:11.036615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-098dba8d-2673-4247-bb0d-1706b822c956 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.134210 Nov 21 17:52:11.037253 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 753/1513] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:10 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:12.054170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:12.054716 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:12.060637 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:12.061081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:12.061837 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:12.062269 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:12.180934 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:12.188106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-74659455-2fba-4e6e-a708-a4372576645c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.138328 Nov 21 17:52:12.188664 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 761/1514] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:12 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:13.205259 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:13.205876 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:13.212458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:13.212908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:13.213666 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:13.214102 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:13.333567 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:13.340902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-1d2bcda0-f818-41d6-99a0-897110241aaf tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.139297 Nov 21 17:52:13.341458 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 754/1515] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:13 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:14.358127 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:14.358751 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:14.364758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:14.365703 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:14.366857 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:14.367295 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:14.482994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:14.490056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dc48e957-4df8-40c8-b941-ae0189456156 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.135547 Nov 21 17:52:14.491746 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 762/1516] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:14 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:15.507856 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:15.508377 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:15.514111 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.514560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.515395 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.515831 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.632256 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:15.639598 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-a1d85cda-ef4c-48a2-9087-fae81043a3a2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.135584 Nov 21 17:52:15.640212 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 755/1517] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:15 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:15.693731 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:52:15.694721 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:15.700510 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.700959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.701712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.702142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.773134 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-56f4b6f5-213e-4b05-9198-3968eb8709d5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action" status: 202 len: 0 microversion: 2.1 time: 0.081801 Nov 21 17:52:15.773843 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 763/1518] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:52:15 2021] POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:52:15.782636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:15.783469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:15.789968 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.790495 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.791455 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:15.791949 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:15.994778 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:16.002498 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-369cc542-351b-4257-8076-f1c61c170230 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1750 microversion: 2.1 time: 0.224691 Nov 21 17:52:16.003101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 756/1519] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:15 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:16.656577 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:16.657271 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:16.663948 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:16.664385 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:16.665160 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:16.665582 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:16.783584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:16.791860 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-798bbc4a-c5fa-459b-afc7-ddd09435eeca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.139203 Nov 21 17:52:16.792430 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 764/1520] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:16 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:16.943061 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-8ffaa5bf-48a7-4265-bd88-b133e549ce29 req-b468209c-84be-4911-aaa0-484a196492ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8f0a13-6c04-4d4e-bf79-c03685aee59e", "name": "network-vif-plugged", "status": "completed", "tag": "01665633-4e1f-4fd5-ab59-36fa4857cabe"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:52:16.945199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:52:16.945199 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:52:16.952429 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-8ffaa5bf-48a7-4265-bd88-b133e549ce29 req-b468209c-84be-4911-aaa0-484a196492ad service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:16.952879 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-8ffaa5bf-48a7-4265-bd88-b133e549ce29 req-b468209c-84be-4911-aaa0-484a196492ad service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:16.965606 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-8ffaa5bf-48a7-4265-bd88-b133e549ce29 req-b468209c-84be-4911-aaa0-484a196492ad service nova] Creating event network-vif-plugged:01665633-4e1f-4fd5-ab59-36fa4857cabe for instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e on hv-cinder-81869 Nov 21 17:52:16.970416 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-8ffaa5bf-48a7-4265-bd88-b133e549ce29 req-b468209c-84be-4911-aaa0-484a196492ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Nov 21 17:52:16.971037 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 757/1521] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:52:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:52:17.020251 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:17.020897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:17.027742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:17.028194 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:17.028959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:17.029394 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:17.154475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:17.162652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-090a2243-8099-45d9-b2cf-1a19666f14ec tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.146226 Nov 21 17:52:17.163150 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 765/1522] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:17 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:17.809572 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:17.810299 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:17.816335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:17.816787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:17.817548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:17.818382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:17.940668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:17.948338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-616187ea-72fb-48a7-92ca-24654921b81e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1266 microversion: 2.1 time: 0.142801 Nov 21 17:52:17.948899 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 758/1523] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:17 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:18.180029 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:18.180635 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:18.186361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:18.186842 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:18.187592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:18.188022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:18.308101 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:18.315750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-38f3be4c-50d1-45c8-8211-a94719359421 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.139481 Nov 21 17:52:18.316305 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 766/1524] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:18 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:18.965820 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:18.966381 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:18.972158 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:18.972609 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:18.973631 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:18.974084 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:19.092755 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:19.100810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9ed637ee-b4fb-4a03-8e2d-dbfe7220bb3d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1453 microversion: 2.1 time: 0.138715 Nov 21 17:52:19.101369 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 759/1525] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:18 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:19.117180 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:19.117827 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:19.123666 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:19.124119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:19.124880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:19.125315 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:19.243366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:19.250549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-91b52fa9-ff76-4e95-aa57-24f496f80872 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1453 microversion: 2.1 time: 0.137701 Nov 21 17:52:19.251141 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 767/1526] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:19 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:19.332931 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:19.333538 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:19.339249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:19.339697 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:19.340459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:19.340889 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:19.519214 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:19.527423 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4be7645f-beb0-4db2-b14e-bf92c16528f7 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.198103 Nov 21 17:52:19.527991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 760/1527] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:19 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:20.545047 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:20.545686 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:20.552012 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:20.552465 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:20.553331 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:20.553768 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:20.785477 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:20.793396 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6775215e-00d4-4af6-8021-bcdef08683da tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.251969 Nov 21 17:52:20.793959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 768/1528] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:20 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:20.975020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-be007609-90c6-466a-b47d-b6d7c553b91a req-37749933-57db-4e81-8373-2837d512f0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8f0a13-6c04-4d4e-bf79-c03685aee59e", "tag": "01665633-4e1f-4fd5-ab59-36fa4857cabe"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:52:20.976798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:52:20.976798 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:52:20.983749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-be007609-90c6-466a-b47d-b6d7c553b91a req-37749933-57db-4e81-8373-2837d512f0d9 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:20.984268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-be007609-90c6-466a-b47d-b6d7c553b91a req-37749933-57db-4e81-8373-2837d512f0d9 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:20.996348 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-be007609-90c6-466a-b47d-b6d7c553b91a req-37749933-57db-4e81-8373-2837d512f0d9 service nova] Creating event network-changed:01665633-4e1f-4fd5-ab59-36fa4857cabe for instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e on hv-cinder-81869 Nov 21 17:52:21.001466 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-be007609-90c6-466a-b47d-b6d7c553b91a req-37749933-57db-4e81-8373-2837d512f0d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030665 Nov 21 17:52:21.002459 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 761/1529] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:52:21.810875 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:21.811533 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:21.817690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:21.818222 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:21.819148 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:21.819595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:21.945959 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:21.953986 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9472ed36-7fa5-425e-8950-392d5fdf20b2 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.146693 Nov 21 17:52:21.954561 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 769/1530] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:21 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:22.971929 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:22.972558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:22.979118 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:22.979560 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:22.980310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:22.980735 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:23.101717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:23.109333 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4aaf2a2d-b1a8-4fe6-8acc-7d98eb916080 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.141482 Nov 21 17:52:23.109894 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 762/1531] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:22 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:24.125972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:24.126579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:24.132949 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:24.133393 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:24.134149 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:24.134579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:24.258909 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:24.266587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b6880002-7b27-4493-bc37-c5434ce15848 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.144240 Nov 21 17:52:24.267169 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 770/1532] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:24 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:25.284643 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:25.285255 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:25.291688 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:25.292132 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:25.292895 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:25.293332 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:25.413900 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:25.421594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d4d31737-b47f-40f3-b86c-33c68aca493c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.140649 Nov 21 17:52:25.422161 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 763/1533] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:25 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:26.439558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:26.440202 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:26.446495 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:26.446957 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:26.447707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:26.448137 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:26.565632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:26.573922 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6941b6a3-1f09-4e62-bb96-5df1de82ca6c tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1755 microversion: 2.1 time: 0.138023 Nov 21 17:52:26.574480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 771/1534] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:26 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1755 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:52:27.590876 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:52:27.591481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:52:27.597225 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:27.597660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:27.598676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:52:27.599580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:52:27.723945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:52:27.732238 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e324f02f-4209-4fbf-a2af-c18302187f6a tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1758 microversion: 2.1 time: 0.145036 Nov 21 17:52:27.732800 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 764/1535] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:52:27 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:53:02.765346 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1727116551"}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:53:02.765877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:02.771846 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:02.772289 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:02.773043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:02.773471 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:02.887519 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.network.security_group_api [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Removing security group 0ded680c-893c-4046-8d81-eda6bc332702 from port 215b8d08-a8fd-4000-bb83-5aaadda19562 Nov 21 17:53:03.208279 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-a03f399b-d38e-4513-97b7-5d7ec64840bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action" status: 202 len: 0 microversion: 2.1 time: 0.446723 Nov 21 17:53:03.209598 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 772/1536] 10.222.0.52 () {60 vars in 1277 bytes} [Sun Nov 21 17:53:02 2021] POST /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:53:03.221723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-7a061799-ede0-4266-bc90-6151eee70dc4 req-b54ec411-b8c8-45e1-8139-8dc7aee84a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:53:03.227763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:53:03.227763 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:53:03.236753 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7a061799-ede0-4266-bc90-6151eee70dc4 req-b54ec411-b8c8-45e1-8139-8dc7aee84a7c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:03.237480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-7a061799-ede0-4266-bc90-6151eee70dc4 req-b54ec411-b8c8-45e1-8139-8dc7aee84a7c service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:03.250101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-7a061799-ede0-4266-bc90-6151eee70dc4 req-b54ec411-b8c8-45e1-8139-8dc7aee84a7c service nova] Creating event network-changed:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:53:03.255826 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-7a061799-ede0-4266-bc90-6151eee70dc4 req-b54ec411-b8c8-45e1-8139-8dc7aee84a7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039198 Nov 21 17:53:03.256832 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 765/1537] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:53:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:53:04.746550 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:04.747106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:04.753224 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:04.753706 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:04.754480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:04.754936 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:04.848782 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.objects.instance [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lazy-loading 'services' on Instance uuid 2ecac302-74cb-4440-847f-73cd9f1c1899 {{(pid=115853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 21 17:53:04.913972 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fd650836-1691-41a1-8b64-870cf42b20b5 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments/56db4327-44e9-41f9-b216-6b6af34405b8" status: 202 len: 0 microversion: 2.1 time: 0.170985 Nov 21 17:53:04.914600 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 773/1538] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:53:04 2021] DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments/56db4327-44e9-41f9-b216-6b6af34405b8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:53:04.923481 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:04.924708 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:04.932307 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:04.932756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:04.933528 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:04.934419 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:04.965806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cbe0c189-c2b5-4b08-b17e-e0d6579e65fc tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046397 Nov 21 17:53:04.966716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 766/1539] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:53:04 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:53:05.274223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-a885f674-9dd7-465f-909d-e949e0eafda3 req-a5076077-3438-4360-844a-71718b5b61c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:53:05.275792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:53:05.275792 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:53:05.282634 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-a885f674-9dd7-465f-909d-e949e0eafda3 req-a5076077-3438-4360-844a-71718b5b61c3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:05.283083 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-a885f674-9dd7-465f-909d-e949e0eafda3 req-a5076077-3438-4360-844a-71718b5b61c3 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:05.294028 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-a885f674-9dd7-465f-909d-e949e0eafda3 req-a5076077-3438-4360-844a-71718b5b61c3 service nova] Creating event network-changed:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:53:05.298804 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-a885f674-9dd7-465f-909d-e949e0eafda3 req-a5076077-3438-4360-844a-71718b5b61c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029077 Nov 21 17:53:05.299367 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 774/1540] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:53:05.978925 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:05.979756 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:05.985397 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:05.985842 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:05.986653 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:05.987100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:06.014157 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-66d01768-3725-477d-8e72-cbcbbc0a8390 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039805 Nov 21 17:53:06.014717 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 767/1541] 10.222.0.52 () {58 vars in 1301 bytes} [Sun Nov 21 17:53:05 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 21 17:53:06.025412 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:06.026033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:06.031930 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:06.032379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:06.033142 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:06.033580 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:06.109445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] HTTP exception thrown: Instance 2ecac302-74cb-4440-847f-73cd9f1c1899 is not attached to volume 56db4327-44e9-41f9-b216-6b6af34405b8 Nov 21 17:53:06.110066 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Returning 404 to user: Instance 2ecac302-74cb-4440-847f-73cd9f1c1899 is not attached to volume 56db4327-44e9-41f9-b216-6b6af34405b8 {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:53:06.110931 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-90e29123-ddd0-47b6-a956-392233353a2e tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments/56db4327-44e9-41f9-b216-6b6af34405b8" status: 404 len: 154 microversion: 2.1 time: 0.090339 Nov 21 17:53:06.111523 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 775/1542] 10.222.0.52 () {58 vars in 1415 bytes} [Sun Nov 21 17:53:06 2021] DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899/os-volume_attachments/56db4327-44e9-41f9-b216-6b6af34405b8 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:53:07.246759 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:07.247257 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:07.252923 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:07.253372 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:07.254128 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:07.254563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:07.278934 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Going to try to terminate instance {{(pid=115854) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:53:07.351884 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-cb03bf51-3bd9-412d-a28e-a6f9ea113a0b tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 204 len: 0 microversion: 2.1 time: 0.108569 Nov 21 17:53:07.352465 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 768/1543] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:53:07 2021] DELETE /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:53:07.360490 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:07.361108 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:07.367090 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:07.367543 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:07.368306 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:07.368741 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:07.487403 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:53:07.495336 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2015e48f-707f-4883-b692-450f13693305 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1552 microversion: 2.1 time: 0.138627 Nov 21 17:53:07.495897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 776/1544] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:53:07 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1552 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:53:08.512790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:08.513488 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:08.519334 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:08.519787 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:08.520551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:08.520991 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:08.640716 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:53:08.648345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-77d98e05-067f-43ed-a10f-be65cecfdfeb tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1552 microversion: 2.1 time: 0.139672 Nov 21 17:53:08.648898 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 769/1545] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:53:08 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1552 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:53:09.664880 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:09.665402 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:09.671223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:09.671680 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:09.672445 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:09.672882 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:09.769167 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97099c133d0144ad975f1caa7ccea71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7400dbf3124e3189245696b5d6bfeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:53:09.777871 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-af164c88-4566-41cd-8fd0-3a6a9014c9b1 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 200 len: 1510 microversion: 2.1 time: 0.116683 Nov 21 17:53:09.778457 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 777/1546] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:53:09 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 1510 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:53:09.826736 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-42e7d3c8-0f5c-4938-a395-16ed0dc64488 req-92ffbb7f-83ce-4714-9227-a9fa4c1bfc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecac302-74cb-4440-847f-73cd9f1c1899", "name": "network-vif-deleted", "tag": "215b8d08-a8fd-4000-bb83-5aaadda19562"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:53:09.828221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:53:09.828221 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:53:09.836544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-42e7d3c8-0f5c-4938-a395-16ed0dc64488 req-92ffbb7f-83ce-4714-9227-a9fa4c1bfc0d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:09.837525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-42e7d3c8-0f5c-4938-a395-16ed0dc64488 req-92ffbb7f-83ce-4714-9227-a9fa4c1bfc0d service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:09.849809 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-42e7d3c8-0f5c-4938-a395-16ed0dc64488 req-92ffbb7f-83ce-4714-9227-a9fa4c1bfc0d service nova] Creating event network-vif-deleted:215b8d08-a8fd-4000-bb83-5aaadda19562 for instance 2ecac302-74cb-4440-847f-73cd9f1c1899 on hv-cinder-81869 Nov 21 17:53:09.855786 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-42e7d3c8-0f5c-4938-a395-16ed0dc64488 req-92ffbb7f-83ce-4714-9227-a9fa4c1bfc0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Nov 21 17:53:09.856362 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 770/1547] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:53:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:53:10.795383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:10.796022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] [instance: 2ecac302-74cb-4440-847f-73cd9f1c1899] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:53:10.801818 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:10.802971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:10.803718 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:53:10.804154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:53:10.816973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] HTTP exception thrown: Instance 2ecac302-74cb-4440-847f-73cd9f1c1899 could not be found. Nov 21 17:53:10.817569 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Returning 404 to user: Instance 2ecac302-74cb-4440-847f-73cd9f1c1899 could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:53:10.818361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-14378bc0-85fa-42fe-89f8-491eec878569 tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899" status: 404 len: 111 microversion: 2.1 time: 0.026750 Nov 21 17:53:10.818917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 778/1548] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:53:10 2021] GET /compute/v2.1/servers/2ecac302-74cb-4440-847f-73cd9f1c1899 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:53:10.827305 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0200212f-c908-478d-8c0e-4796086307bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] Calling method '.version_select at 0x7f1fc262b670>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:53:10.844555 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0200212f-c908-478d-8c0e-4796086307bf tempest-TestMinimumBasicScenario-159513832 tempest-TestMinimumBasicScenario-159513832-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-499398185" status: 202 len: 0 microversion: 2.1 time: 0.021261 Nov 21 17:53:10.845104 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 771/1549] 10.222.0.52 () {58 vars in 1268 bytes} [Sun Nov 21 17:53:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-499398185 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:54:13.438237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:54:13.439263 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:54:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:54:18.276538 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:54:18.279929 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:18.280453 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:18.286348 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:18.286832 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:18.287595 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:18.288260 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:18.312549 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:54:18.385286 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fcef886c-a078-4964-b9ed-bed8a2d4e509 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 204 len: 0 microversion: 2.1 time: 0.110633 Nov 21 17:54:18.385858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 779/1550] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:54:18 2021] DELETE /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:54:18.391852 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: ERROR oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] AMQP server on 10.222.0.52:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 21 17:54:18.395561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:18.396452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:18.402656 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:18.403105 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:18.403859 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:18.404284 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:18.523571 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:18.530769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d83030cf-05ec-4c4e-85f1-ead9bb9f832c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1578 microversion: 2.1 time: 0.140686 Nov 21 17:54:18.531320 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 772/1551] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:18 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1578 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:19.548734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:19.549455 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:19.566035 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:19.566483 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:19.567277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:19.567713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:19.584038 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53580. Nov 21 17:54:19.693082 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:19.700823 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-bfc455ba-cced-42a8-8e82-155815c00a23 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1578 microversion: 2.1 time: 0.156204 Nov 21 17:54:19.701379 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 780/1552] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:19 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:20.718403 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:20.719047 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:20.740625 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:20.741696 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:20.743153 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:20.743268 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:20.750189 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] [089d96c4-39a3-411a-911e-d639e3ff98b6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53586. Nov 21 17:54:20.987424 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:20.994880 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-c1b7b206-4315-4d0f-a1e1-4d8961c82083 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 200 len: 1578 microversion: 2.1 time: 0.280362 Nov 21 17:54:20.995450 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 773/1553] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:20 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 1578 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:21.175758 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-5c1d8783-f713-4d81-9b08-1763d26962d5 req-831a3727-c834-427e-97c6-f236f325b7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8f0a13-6c04-4d4e-bf79-c03685aee59e", "name": "network-vif-deleted", "tag": "01665633-4e1f-4fd5-ab59-36fa4857cabe"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:54:21.177361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:54:21.177361 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:54:21.184599 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-5c1d8783-f713-4d81-9b08-1763d26962d5 req-831a3727-c834-427e-97c6-f236f325b7fa service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:21.185033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-5c1d8783-f713-4d81-9b08-1763d26962d5 req-831a3727-c834-427e-97c6-f236f325b7fa service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:21.197266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-5c1d8783-f713-4d81-9b08-1763d26962d5 req-831a3727-c834-427e-97c6-f236f325b7fa service nova] Creating event network-vif-deleted:01665633-4e1f-4fd5-ab59-36fa4857cabe for instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e on hv-cinder-81869 Nov 21 17:54:21.203052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-5c1d8783-f713-4d81-9b08-1763d26962d5 req-831a3727-c834-427e-97c6-f236f325b7fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030886 Nov 21 17:54:21.203894 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 781/1554] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:54:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:54:22.011486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:22.012219 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:22.018229 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:22.018728 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:22.019482 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:22.019907 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:22.033847 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] HTTP exception thrown: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. Nov 21 17:54:22.034469 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Returning 404 to user: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:54:22.035329 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-dd2c53fb-1d3d-44b7-9b28-72a0cb497b4c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 404 len: 111 microversion: 2.1 time: 0.027676 Nov 21 17:54:22.035867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 774/1555] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:22 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:54:22.131235 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-921051865", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343158482", "security_groups": [{"name": "tempest-secgroup-smoke-2010068226"}], "block_device_mapping_v2": [{"uuid": "d4339fcc-d971-471d-b705-6178c4f3d49e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1574b58-abb3-4ac5-834b-391c5735d81c"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:54:22.235617 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] validate_networks() for [('b1574b58-abb3-4ac5-834b-391c5735d81c', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:54:22.588264 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:54:22.588690 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:54:22.589164 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:54:22.589578 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:54:22.590040 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:54:22.599262 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:22.599705 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:22.601099 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:22.601535 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:22.620257 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:54:22.624126 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for user 1e8f63a305ae429c8ab6fc62b920bd32 and project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:54:22.683218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:54:22.686043 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4339fcc-d971-471d-b705-6178c4f3d49e',volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:54:22.807613 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-9f8c9be8-6ef5-4d0c-94a6-166c01ad1f06 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680346 Nov 21 17:54:22.808240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 782/1556] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:54:22 2021] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:54:22.818198 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-208c8aa0-2f30-4b5a-867e-d9c8d5677ad9 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:22.818834 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-208c8aa0-2f30-4b5a-867e-d9c8d5677ad9 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:22.871294 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-208c8aa0-2f30-4b5a-867e-d9c8d5677ad9 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:22.877707 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-208c8aa0-2f30-4b5a-867e-d9c8d5677ad9 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1093 microversion: 2.1 time: 0.063413 Nov 21 17:54:22.886659 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 775/1557] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:22 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:23.895238 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:23.896406 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:23.904356 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:23.904815 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:23.905596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:23.906033 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:23.973345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:23.980907 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-30826456-dadf-48af-9580-81745d738b58 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1209 microversion: 2.1 time: 0.090337 Nov 21 17:54:23.981473 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 783/1558] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:23 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:24.998725 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:24.999379 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:25.005288 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:25.005999 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:25.007338 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:25.007813 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:25.094244 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-b46972ed-4b5d-409e-a87a-3a68f00dd82c req-97523adb-e1b4-41a0-8625-37485d99996f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b801ca-6fe3-45d9-8195-cf37002d42b3", "tag": "3352afde-3c94-4df0-8d6e-8c0a5d1cd33d"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:54:25.095899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:54:25.095899 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:54:25.103780 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-b46972ed-4b5d-409e-a87a-3a68f00dd82c req-97523adb-e1b4-41a0-8625-37485d99996f service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:25.104146 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-b46972ed-4b5d-409e-a87a-3a68f00dd82c req-97523adb-e1b4-41a0-8625-37485d99996f service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:25.116250 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-b46972ed-4b5d-409e-a87a-3a68f00dd82c req-97523adb-e1b4-41a0-8625-37485d99996f service nova] Creating event network-changed:3352afde-3c94-4df0-8d6e-8c0a5d1cd33d for instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 on hv-cinder-81869 Nov 21 17:54:25.121785 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-b46972ed-4b5d-409e-a87a-3a68f00dd82c req-97523adb-e1b4-41a0-8625-37485d99996f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Nov 21 17:54:25.122831 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 784/1559] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:54:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 21 17:54:25.202816 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:25.211715 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-b88fc76c-2a49-4d81-bc77-9bb25b7a66c0 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.217344 Nov 21 17:54:25.221532 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 776/1560] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:24 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:26.229867 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:26.230480 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:26.236408 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:26.236856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:26.237612 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:26.238051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:26.361056 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:26.368284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-b1dcb3cc-09ea-44cc-8887-feb52c9f7d16 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.142526 Nov 21 17:54:26.373313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 785/1561] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:26 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:27.385636 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:27.386232 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:27.392099 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:27.392544 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:27.393310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:27.393742 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:27.510527 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:27.517781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8ce1e986-76d0-4e38-8411-643022010d3f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.135938 Nov 21 17:54:27.518337 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 777/1562] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:27 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:28.534294 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:28.534954 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:28.541418 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:28.541864 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:28.542632 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:28.543072 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:28.660688 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:28.668417 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-01f833b9-7635-457e-8ad4-1d247c3b066b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.137798 Nov 21 17:54:28.668973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 786/1563] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:28 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:29.685025 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:29.685621 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:29.691361 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:29.691802 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:29.692551 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:29.692979 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:29.815100 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:29.823345 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0a8fc037-a7d3-4f77-a0de-6d52231b4e24 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.141976 Nov 21 17:54:29.823902 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 778/1564] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:29 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:30.840709 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:30.841345 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:30.847139 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:30.847584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:30.848328 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:30.849007 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:31.189950 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:31.197102 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-6125025b-105c-4cd2-863d-ef8f96397338 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.360074 Nov 21 17:54:31.197670 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 787/1565] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:30 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:32.213608 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:32.214318 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:32.220144 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:32.220594 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:32.221352 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:32.221794 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:32.340997 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:32.348164 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8fad5b20-9556-4de7-8cb5-abe511e6a05b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.138158 Nov 21 17:54:32.348722 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 779/1566] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:32 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:33.365366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:33.366380 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:33.372398 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:33.372856 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:33.373626 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:33.374121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:33.496487 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:33.503784 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-23ebe8eb-3180-4ad0-be10-fba566e36ede tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.142092 Nov 21 17:54:33.504359 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 788/1567] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:33 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:34.520525 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:34.521127 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:34.526986 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:34.527426 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:34.528171 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:34.528596 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:34.647248 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:34.654434 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-ca78c0a0-f2fe-4aa1-a6da-690316b7ff72 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.137506 Nov 21 17:54:34.655041 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 780/1568] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:34 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:35.561994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-51d98e71-d544-4ce6-be1b-3b2148a81297 req-6c179838-e4de-4d98-96be-8f5c2779f584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b801ca-6fe3-45d9-8195-cf37002d42b3", "name": "network-vif-plugged", "status": "completed", "tag": "3352afde-3c94-4df0-8d6e-8c0a5d1cd33d"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:54:35.563552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:54:35.563552 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:54:35.571559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-51d98e71-d544-4ce6-be1b-3b2148a81297 req-6c179838-e4de-4d98-96be-8f5c2779f584 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:35.572119 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-51d98e71-d544-4ce6-be1b-3b2148a81297 req-6c179838-e4de-4d98-96be-8f5c2779f584 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:35.584000 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-51d98e71-d544-4ce6-be1b-3b2148a81297 req-6c179838-e4de-4d98-96be-8f5c2779f584 service nova] Creating event network-vif-plugged:3352afde-3c94-4df0-8d6e-8c0a5d1cd33d for instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 on hv-cinder-81869 Nov 21 17:54:35.589636 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-51d98e71-d544-4ce6-be1b-3b2148a81297 req-6c179838-e4de-4d98-96be-8f5c2779f584 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031283 Nov 21 17:54:35.590215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 789/1569] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:54:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:54:35.671664 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:35.672207 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:35.678610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:35.679046 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:35.679808 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:35.680237 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:35.830373 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:35.837548 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-e24b3261-aa03-47b2-9666-19d4e93ee4af tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.169572 Nov 21 17:54:35.838111 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 781/1570] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:35 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:36.854652 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:36.855357 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:36.861577 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:36.862064 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:36.862895 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:36.863333 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:36.984081 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:36.991619 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f62b5de9-0025-40b0-b26c-fda4e8cbad91 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1265 microversion: 2.1 time: 0.140964 Nov 21 17:54:36.992183 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 790/1571] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:36 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:38.008810 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:38.009343 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:38.015179 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:38.015626 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:38.016388 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:38.016827 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:38.133611 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:38.140848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-617b96ed-4bee-43a8-9be9-4429e09aa12c tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1452 microversion: 2.1 time: 0.136437 Nov 21 17:54:38.141410 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 782/1572] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:38 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:38.157572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:54:38.158170 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:54:38.164400 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:38.164858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:38.165592 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:38.166019 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:38.286401 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:54:38.293669 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-eed18db7-bbfb-4a0c-9e1f-87e49c453777 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1452 microversion: 2.1 time: 0.139702 Nov 21 17:54:38.294216 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 791/1573] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:54:38 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:54:40.083019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-fa3f440d-7f1e-4715-b557-117834a35ece req-89aba024-efcb-40f6-8d2f-94a12b8834b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b801ca-6fe3-45d9-8195-cf37002d42b3", "tag": "3352afde-3c94-4df0-8d6e-8c0a5d1cd33d"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:54:40.083019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:54:40.083019 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:54:40.088605 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-fa3f440d-7f1e-4715-b557-117834a35ece req-89aba024-efcb-40f6-8d2f-94a12b8834b8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:54:40.089043 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-fa3f440d-7f1e-4715-b557-117834a35ece req-89aba024-efcb-40f6-8d2f-94a12b8834b8 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:54:40.100184 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-fa3f440d-7f1e-4715-b557-117834a35ece req-89aba024-efcb-40f6-8d2f-94a12b8834b8 service nova] Creating event network-changed:3352afde-3c94-4df0-8d6e-8c0a5d1cd33d for instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 on hv-cinder-81869 Nov 21 17:54:40.105040 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-fa3f440d-7f1e-4715-b557-117834a35ece req-89aba024-efcb-40f6-8d2f-94a12b8834b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028664 Nov 21 17:54:40.106310 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 783/1574] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:54:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:55:03.226602 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:55:03.227124 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:55:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:55:57.368848 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:55:57.369430 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:55:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:56:14.237742 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1913424358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-343158482", "security_groups": [{"name": "tempest-secgroup-smoke-2010068226"}], "block_device_mapping_v2": [{"uuid": "38b21e6d-1469-431f-8768-d6aa29edaf4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b1574b58-abb3-4ac5-834b-391c5735d81c"}]}} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:56:14.500267 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.network.neutron [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] validate_networks() for [('b1574b58-abb3-4ac5-834b-391c5735d81c', None, None, None, None, None)] {{(pid=115853) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 21 17:56:14.962873 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 21 17:56:14.963299 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image limits 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 21 17:56:14.963774 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Flavor pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 21 17:56:14.964185 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Image pref 0:0:0 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 21 17:56:14.964629 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.virt.hardware [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 21 17:56:14.973297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:14.973736 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:14.974840 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:14.975266 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:14.995969 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 21 17:56:15.001006 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.quota [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Getting quotas for user 1e8f63a305ae429c8ab6fc62b920bd32 and project 7d0e24068212426f85e492e396995ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=115853) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 21 17:56:15.065874 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Going to run 1 instances... {{(pid=115853) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 21 17:56:15.068024 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38b21e6d-1469-431f-8768-d6aa29edaf4d',volume_size=None,volume_type=None)] {{(pid=115853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 21 17:56:15.189080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-e5323af7-f9b2-42dd-9a78-04516656bb17 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955730 Nov 21 17:56:15.189712 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 792/1575] 10.222.0.52 () {60 vars in 1146 bytes} [Sun Nov 21 17:56:14 2021] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 21 17:56:15.201028 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5973aa6c-5069-4529-a6f0-428c83e696c4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:15.201747 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5973aa6c-5069-4529-a6f0-428c83e696c4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:15.310824 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5973aa6c-5069-4529-a6f0-428c83e696c4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:15.317282 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5973aa6c-5069-4529-a6f0-428c83e696c4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1094 microversion: 2.1 time: 0.121461 Nov 21 17:56:15.317841 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 784/1576] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:15 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:16.334443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:16.335080 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:16.342229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:16.342700 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:16.343464 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:16.343993 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:16.421798 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:16.429389 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-d397259b-7e52-4cdb-8f46-89f5d1f1f27f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1210 microversion: 2.1 time: 0.098678 Nov 21 17:56:16.430155 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 793/1577] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:16 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:17.448668 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:17.449289 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:17.456799 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:17.457335 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:17.458007 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:17.458438 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:17.635579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [req-818e6eda-2103-4b1d-814f-05cc429da6ff req-b8cbc0c3-2888-4748-aa1c-ac3498e7ac29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0e12ca-734d-45cb-83e0-fdfcd98af745", "tag": "73dabe09-a80d-43f1-86e4-2b84448d0579"}]} {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:56:17.638383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:56:17.638383 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: warnings.warn(msg) Nov 21 17:56:17.645777 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-818e6eda-2103-4b1d-814f-05cc429da6ff req-b8cbc0c3-2888-4748-aa1c-ac3498e7ac29 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:17.646475 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [req-818e6eda-2103-4b1d-814f-05cc429da6ff req-b8cbc0c3-2888-4748-aa1c-ac3498e7ac29 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:17.658642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.compute.server_external_events [req-818e6eda-2103-4b1d-814f-05cc429da6ff req-b8cbc0c3-2888-4748-aa1c-ac3498e7ac29 service nova] Creating event network-changed:73dabe09-a80d-43f1-86e4-2b84448d0579 for instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 on hv-cinder-81869 Nov 21 17:56:17.664335 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [req-818e6eda-2103-4b1d-814f-05cc429da6ff req-b8cbc0c3-2888-4748-aa1c-ac3498e7ac29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033433 Nov 21 17:56:17.665614 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 794/1578] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:56:17.700919 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:17.709837 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-26239088-b9a9-427e-a8c0-8f6fec9c1a70 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.266487 Nov 21 17:56:17.710597 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 785/1579] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:17 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:18.728440 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:18.729136 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:18.735121 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:18.735559 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:18.736366 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:18.736733 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:18.859750 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:18.867363 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-fb3c3f8c-6584-4dc9-b27d-afb85446bc80 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.143429 Nov 21 17:56:18.868676 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 795/1580] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:18 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:19.884336 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:19.884946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:19.890723 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:19.891174 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:19.891939 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:19.892376 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:20.010464 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:20.017661 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-4582f53f-352c-4895-9667-4073a463e1b4 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.136993 Nov 21 17:56:20.018211 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 786/1581] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:19 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:21.035079 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:21.035620 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:21.042154 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:21.042587 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:21.043375 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:21.043814 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:21.166223 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:21.173284 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-227e28f2-a524-43ce-a49c-2a0154d14ba2 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.142151 Nov 21 17:56:21.173833 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 796/1582] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:21 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:22.189085 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:22.189701 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:22.195648 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:22.196749 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:22.197509 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:22.197946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:22.315168 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:22.322480 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-5090f81b-bf4d-4ff6-bb47-b08459c405ca tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.137048 Nov 21 17:56:22.323072 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 787/1583] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:22 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:23.339240 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:23.339851 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:23.345865 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:23.346321 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:23.347129 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:23.347596 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:23.465292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:23.472404 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-ad65f706-bcdf-4943-a83b-e8bfa9381952 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.136940 Nov 21 17:56:23.472955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 797/1584] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:23 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:24.489700 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:24.490301 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:24.496660 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:24.497093 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:24.497835 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:24.498258 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:24.618945 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:24.625981 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-0479af2d-e1cc-4a6f-a766-965b6b3fc974 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.139879 Nov 21 17:56:24.626531 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 788/1585] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:24 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:25.642488 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:25.643122 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:25.649431 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:25.649891 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:25.650682 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:25.651123 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:25.766759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:25.774429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-3ea2de9e-1928-49a1-ab1a-11fc0815b240 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.135069 Nov 21 17:56:25.775020 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 798/1586] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:25 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:26.791249 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:26.791868 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:26.797946 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:26.798391 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:26.799178 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:26.799615 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:26.917197 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:26.924478 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-54c0c97c-830e-4bcf-a3df-923fea01d751 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.136858 Nov 21 17:56:26.925034 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 789/1587] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:26 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:27.941147 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:27.941744 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:27.948074 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:27.948526 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:27.949297 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:27.949734 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:28.071096 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:28.078713 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c886ddb5-bae1-4803-bf6c-a40a8197bf7e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.141095 Nov 21 17:56:28.079313 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 799/1588] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:27 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:28.188493 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-4471887c-6732-4e54-bbf8-932ae6bf63fe req-0d08bc82-e3b7-4385-9caf-1e01fadc2b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0e12ca-734d-45cb-83e0-fdfcd98af745", "name": "network-vif-plugged", "status": "completed", "tag": "73dabe09-a80d-43f1-86e4-2b84448d0579"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:56:28.190003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:56:28.190003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:56:28.197148 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-4471887c-6732-4e54-bbf8-932ae6bf63fe req-0d08bc82-e3b7-4385-9caf-1e01fadc2b47 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:28.197672 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-4471887c-6732-4e54-bbf8-932ae6bf63fe req-0d08bc82-e3b7-4385-9caf-1e01fadc2b47 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:28.209950 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-4471887c-6732-4e54-bbf8-932ae6bf63fe req-0d08bc82-e3b7-4385-9caf-1e01fadc2b47 service nova] Creating event network-vif-plugged:73dabe09-a80d-43f1-86e4-2b84448d0579 for instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 on hv-cinder-81869 Nov 21 17:56:28.215838 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-4471887c-6732-4e54-bbf8-932ae6bf63fe req-0d08bc82-e3b7-4385-9caf-1e01fadc2b47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030874 Nov 21 17:56:28.216673 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 790/1589] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:56:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:56:29.096159 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:29.096759 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:29.103437 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:29.103881 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:29.104625 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:29.105051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:29.222068 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:29.229926 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-13475303-ab6d-49ad-936e-70e6ab5ddb0d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1266 microversion: 2.1 time: 0.137518 Nov 21 17:56:29.230476 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 800/1590] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:29 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:30.246819 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:30.247506 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:30.253453 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:30.253887 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:30.254644 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:30.255077 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:30.377867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:30.385998 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-46a54119-4ff4-42fc-8de0-ff00abc3a1d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1453 microversion: 2.1 time: 0.143720 Nov 21 17:56:30.386561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 791/1591] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:30 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:30.402017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:56:30.402648 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:56:30.408343 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:30.408795 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:30.409555 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:30.409994 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:30.530707 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:56:30.537836 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-aeeec7b6-e762-4670-852b-8cd18c16f825 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1453 microversion: 2.1 time: 0.139476 Nov 21 17:56:30.538388 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 801/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:56:30 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:56:32.170444 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-d8c6b6e8-dc4b-460f-9fbb-0d5fc61d4d7a req-274e5c8b-34c2-4bcc-85af-2ce19ee7e793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0e12ca-734d-45cb-83e0-fdfcd98af745", "tag": "73dabe09-a80d-43f1-86e4-2b84448d0579"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:56:32.172002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:56:32.172002 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:56:32.178561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d8c6b6e8-dc4b-460f-9fbb-0d5fc61d4d7a req-274e5c8b-34c2-4bcc-85af-2ce19ee7e793 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:56:32.179239 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-d8c6b6e8-dc4b-460f-9fbb-0d5fc61d4d7a req-274e5c8b-34c2-4bcc-85af-2ce19ee7e793 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:56:32.191721 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-d8c6b6e8-dc4b-460f-9fbb-0d5fc61d4d7a req-274e5c8b-34c2-4bcc-85af-2ce19ee7e793 service nova] Creating event network-changed:73dabe09-a80d-43f1-86e4-2b84448d0579 for instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 on hv-cinder-81869 Nov 21 17:56:32.197295 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-d8c6b6e8-dc4b-460f-9fbb-0d5fc61d4d7a req-274e5c8b-34c2-4bcc-85af-2ce19ee7e793 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092480 Nov 21 17:56:32.198115 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 792/1593] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:56:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:57:33.455897 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:57:33.456581 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:57:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:58:02.063434 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 21 17:58:02.067384 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:02.067897 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:02.074022 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:02.074668 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:02.075461 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:02.075892 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:02.101928 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:58:02.126563 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-1e19ce9f-fbce-4d1e-a2b6-1d40572acc11 req-c9d6dcd5-5a33-4f2e-a8af-85a89d198c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc0e12ca-734d-45cb-83e0-fdfcd98af745", "tag": "73dabe09-a80d-43f1-86e4-2b84448d0579"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:58:02.128790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:58:02.128790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:58:02.137658 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-1e19ce9f-fbce-4d1e-a2b6-1d40572acc11 req-c9d6dcd5-5a33-4f2e-a8af-85a89d198c5e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:02.138365 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-1e19ce9f-fbce-4d1e-a2b6-1d40572acc11 req-c9d6dcd5-5a33-4f2e-a8af-85a89d198c5e service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:02.151003 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-1e19ce9f-fbce-4d1e-a2b6-1d40572acc11 req-c9d6dcd5-5a33-4f2e-a8af-85a89d198c5e service nova] Creating event network-changed:73dabe09-a80d-43f1-86e4-2b84448d0579 for instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 on hv-cinder-81869 Nov 21 17:58:02.156781 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-1e19ce9f-fbce-4d1e-a2b6-1d40572acc11 req-c9d6dcd5-5a33-4f2e-a8af-85a89d198c5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091536 Nov 21 17:58:02.160382 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 793/1594] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:58:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:58:02.187186 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-f6755cef-73a0-4141-b9bd-9a4b55a10e48 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 204 len: 0 microversion: 2.1 time: 0.126030 Nov 21 17:58:02.188245 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 802/1595] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:58:02 2021] DELETE /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:58:02.200676 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:02.201640 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:02.208001 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:02.208452 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:02.209239 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:02.209671 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:02.407470 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:02.415273 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-20c9a247-2527-4ee0-8ec1-c5dec92e31d7 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1578 microversion: 2.1 time: 0.222444 Nov 21 17:58:02.416112 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 794/1596] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:02 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:58:03.433051 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:03.433659 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:03.449999 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:03.450441 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:03.451821 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:03.452877 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:03.468277 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] [21de61ea-f52c-4ee0-9538-7b932cf9b124] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53852. Nov 21 17:58:03.577977 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:03.585207 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-8473aeb6-de59-4932-9867-5343c0d887b8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1459 microversion: 2.1 time: 0.156315 Nov 21 17:58:03.585762 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 803/1597] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:03 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:58:04.499251 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-ad200cf7-1e01-41ae-995b-c9050c41af80 req-7c701858-79f9-4b9b-9e07-bc69eef47949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc0e12ca-734d-45cb-83e0-fdfcd98af745", "name": "network-vif-deleted", "tag": "73dabe09-a80d-43f1-86e4-2b84448d0579"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:58:04.500995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:58:04.500995 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:58:04.508547 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-ad200cf7-1e01-41ae-995b-c9050c41af80 req-7c701858-79f9-4b9b-9e07-bc69eef47949 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:04.509006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-ad200cf7-1e01-41ae-995b-c9050c41af80 req-7c701858-79f9-4b9b-9e07-bc69eef47949 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:04.520431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-ad200cf7-1e01-41ae-995b-c9050c41af80 req-7c701858-79f9-4b9b-9e07-bc69eef47949 service nova] Creating event network-vif-deleted:73dabe09-a80d-43f1-86e4-2b84448d0579 for instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 on hv-cinder-81869 Nov 21 17:58:04.525590 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-ad200cf7-1e01-41ae-995b-c9050c41af80 req-7c701858-79f9-4b9b-9e07-bc69eef47949 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Nov 21 17:58:04.526176 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 795/1598] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:58:04.601699 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:04.602318 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:04.608292 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:04.608820 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:04.609579 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:04.610017 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:04.668971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:04.676421 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-dfc8440f-95ba-417f-8981-25c0de781b7d tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 200 len: 1225 microversion: 2.1 time: 0.078782 Nov 21 17:58:04.676982 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 804/1599] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:04 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:58:05.693738 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:05.694435 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: dc0e12ca-734d-45cb-83e0-fdfcd98af745] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:05.700460 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:05.700908 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:05.701692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:05.702129 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:05.715432 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] HTTP exception thrown: Instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 could not be found. Nov 21 17:58:05.716020 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Returning 404 to user: Instance dc0e12ca-734d-45cb-83e0-fdfcd98af745 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:58:05.716845 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-8374aa4c-5297-44c0-9c71-9fec8109e72e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745" status: 404 len: 111 microversion: 2.1 time: 0.027141 Nov 21 17:58:05.717378 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 796/1600] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:05 2021] GET /compute/v2.1/servers/dc0e12ca-734d-45cb-83e0-fdfcd98af745 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:58:08.759057 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:08.759584 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:08.762070 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-4e34ff13-a1f1-4253-8daf-fe5b10bf4385 req-4a387d2d-01fc-4243-bf7e-05bb83836e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b801ca-6fe3-45d9-8195-cf37002d42b3", "tag": "3352afde-3c94-4df0-8d6e-8c0a5d1cd33d"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:58:08.763588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:58:08.763588 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:58:08.765917 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:08.766322 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:08.767218 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:08.767720 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:08.770474 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-4e34ff13-a1f1-4253-8daf-fe5b10bf4385 req-4a387d2d-01fc-4243-bf7e-05bb83836e24 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:08.770937 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-4e34ff13-a1f1-4253-8daf-fe5b10bf4385 req-4a387d2d-01fc-4243-bf7e-05bb83836e24 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:08.784447 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-4e34ff13-a1f1-4253-8daf-fe5b10bf4385 req-4a387d2d-01fc-4243-bf7e-05bb83836e24 service nova] Creating event network-changed:3352afde-3c94-4df0-8d6e-8c0a5d1cd33d for instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 on hv-cinder-81869 Nov 21 17:58:08.789806 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-4e34ff13-a1f1-4253-8daf-fe5b10bf4385 req-4a387d2d-01fc-4243-bf7e-05bb83836e24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031664 Nov 21 17:58:08.790566 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 797/1601] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:58:08.793572 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Going to try to terminate instance {{(pid=115853) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 21 17:58:08.878813 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-48e2d1f2-aaa6-4651-b8bf-a130d426303f tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 204 len: 0 microversion: 2.1 time: 0.123120 Nov 21 17:58:08.879828 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 805/1602] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:58:08 2021] DELETE /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 21 17:58:08.888079 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:08.888772 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:08.897980 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:08.898431 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:08.899241 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:08.899674 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:09.092580 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.policy [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115854) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:09.103777 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-d587c4bd-8480-4e75-980c-b1cf1558cb8e tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1576 microversion: 2.1 time: 0.217385 Nov 21 17:58:09.104692 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 798/1603] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:08 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 21 17:58:10.122106 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:10.122869 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:10.129100 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:10.129546 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:10.130303 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:10.130764 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:10.257642 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:10.266213 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-903f0099-c5b3-4bd3-8a28-eb25a633fab8 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1458 microversion: 2.1 time: 0.147993 Nov 21 17:58:10.266816 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 806/1604] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:10 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:58:11.144942 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [req-323c063e-d1b6-4beb-9cb7-29cea3c38dd7 req-2f473fa0-e3b2-4d01-b044-72f35d6ad102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b801ca-6fe3-45d9-8195-cf37002d42b3", "name": "network-vif-deleted", "tag": "3352afde-3c94-4df0-8d6e-8c0a5d1cd33d"}]} {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 21 17:58:11.146486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 21 17:58:11.146486 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: warnings.warn(msg) Nov 21 17:58:11.154323 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-323c063e-d1b6-4beb-9cb7-29cea3c38dd7 req-2f473fa0-e3b2-4d01-b044-72f35d6ad102 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:11.154790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [req-323c063e-d1b6-4beb-9cb7-29cea3c38dd7 req-2f473fa0-e3b2-4d01-b044-72f35d6ad102 service nova] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:11.165828 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.compute.server_external_events [req-323c063e-d1b6-4beb-9cb7-29cea3c38dd7 req-2f473fa0-e3b2-4d01-b044-72f35d6ad102 service nova] Creating event network-vif-deleted:3352afde-3c94-4df0-8d6e-8c0a5d1cd33d for instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 on hv-cinder-81869 Nov 21 17:58:11.170769 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [req-323c063e-d1b6-4beb-9cb7-29cea3c38dd7 req-2f473fa0-e3b2-4d01-b044-72f35d6ad102 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029406 Nov 21 17:58:11.171479 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 799/1605] 10.222.0.52 () {64 vars in 1317 bytes} [Sun Nov 21 17:58:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 21 17:58:11.282955 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:11.283558 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:11.289229 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:11.289695 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:11.290443 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:11.290902 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:11.350052 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.policy [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8f63a305ae429c8ab6fc62b920bd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0e24068212426f85e492e396995ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115853) authorize /opt/stack/nova/nova/policy.py:199}} Nov 21 17:58:11.357971 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-519714f3-e1e9-4c04-a406-f63305672c3b tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 200 len: 1224 microversion: 2.1 time: 0.079175 Nov 21 17:58:11.358481 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 807/1606] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:11 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 21 17:58:12.376401 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:12.377101 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 82b801ca-6fe3-45d9-8195-cf37002d42b3] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:12.383136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.383584 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.384346 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.384790 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.398561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] HTTP exception thrown: Instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 could not be found. Nov 21 17:58:12.399172 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Returning 404 to user: Instance 82b801ca-6fe3-45d9-8195-cf37002d42b3 could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:58:12.399982 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-9f801177-14fc-48e3-b847-6b9ed4d6dceb tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3" status: 404 len: 111 microversion: 2.1 time: 0.028377 Nov 21 17:58:12.400496 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 800/1607] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:12 2021] GET /compute/v2.1/servers/82b801ca-6fe3-45d9-8195-cf37002d42b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:58:12.836031 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:12.836515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.compute.api [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115853) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:12.842217 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.842717 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.843544 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.843879 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG oslo_concurrency.lockutils [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.856898 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.wsgi [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] HTTP exception thrown: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. Nov 21 17:58:12.857479 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Returning 404 to user: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. {{(pid=115853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:58:12.858274 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-2733596b-debb-4d6b-8428-c99359945333 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 404 len: 111 microversion: 2.1 time: 0.025913 Nov 21 17:58:12.858818 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 808/1608] 10.222.0.52 () {58 vars in 1238 bytes} [Sun Nov 21 17:58:12 2021] DELETE /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:58:12.867272 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '>' {{(pid=115854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:12.867886 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.compute.api [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [instance: 1e8f0a13-6c04-4d4e-bf79-c03685aee59e] Fetching instance by UUID {{(pid=115854) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 21 17:58:12.873558 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.874006 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.874867 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 21 17:58:12.875891 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG oslo_concurrency.lockutils [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Lock "30be9fce-2665-48f2-b5e2-b49d52c4b8ef" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 21 17:58:12.888561 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.wsgi [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] HTTP exception thrown: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. Nov 21 17:58:12.889136 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: DEBUG nova.api.openstack.wsgi [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Returning 404 to user: Instance 1e8f0a13-6c04-4d4e-bf79-c03685aee59e could not be found. {{(pid=115854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 21 17:58:12.889933 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO nova.api.openstack.requestlog [None req-82a2847b-070b-49a1-9ff7-72f52240e82a tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e" status: 404 len: 111 microversion: 2.1 time: 0.026470 Nov 21 17:58:12.890445 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: [pid: 115854|app: 0|req: 801/1609] 10.222.0.52 () {58 vars in 1235 bytes} [Sun Nov 21 17:58:12 2021] GET /compute/v2.1/servers/1e8f0a13-6c04-4d4e-bf79-c03685aee59e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 21 17:58:14.167112 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: DEBUG nova.api.openstack.wsgi [None req-c2927787-35ba-461c-b39b-81420402b140 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] Calling method '.version_select at 0x7f1fbd806ee0>' {{(pid=115853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 21 17:58:14.171215 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2927787-35ba-461c-b39b-81420402b140 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [8557d4f9-9e62-4320-ac7e-fe7793d6161d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 21 17:58:15.188923 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2927787-35ba-461c-b39b-81420402b140 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] [8557d4f9-9e62-4320-ac7e-fe7793d6161d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 53908. Nov 21 17:58:15.206973 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO nova.api.openstack.requestlog [None req-c2927787-35ba-461c-b39b-81420402b140 tempest-TestVolumeBootPattern-1285335624 tempest-TestVolumeBootPattern-1285335624-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-343158482" status: 202 len: 0 microversion: 2.1 time: 1.043453 Nov 21 17:58:15.207545 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: [pid: 115853|app: 0|req: 809/1610] 10.222.0.52 () {58 vars in 1259 bytes} [Sun Nov 21 17:58:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-343158482 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 21 17:59:17.312858 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:59:17.313515 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 17:59:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 17:59:17.386610 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 17:59:17.387087 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 17:59:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:00:53.473669 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:00:53.474349 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 18:00:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:01:14.515850 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:01:14.516564 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 18:01:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:01:25.398790 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:01:25.399429 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 18:01:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:02:37.329876 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:02:37.330541 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 18:02:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:02:37.403030 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:02:37.403513 dv-cinder-818696-2-iscsi devstack@n-api.service[115854]: Sun Nov 21 18:02:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 21 18:03:23.250577 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 21 18:03:23.251131 dv-cinder-818696-2-iscsi devstack@n-api.service[115853]: Sun Nov 21 18:03:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!